Trace number 1780480

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 3001.6 1000.07

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UCG-15-10p1.cnf
MD5SUM484dad50fb275faff8eff92c4d5447cb
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1357.99
Satisfiable
(Un)Satisfiability was proved
Number of variables200003
Number of clauses1019221
Sum of the clauses size2431032
Maximum clause length10
Minimum clause length1
Number of clauses of size 110249
Number of clauses of size 2759013
Number of clauses of size 3198999
Number of clauses of size 45660
Number of clauses of size 522640
Number of clauses of size over 522660

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780480-1243648128/watcher-1780480-1243648128 -o /tmp/evaluation-result-1780480-1243648128/solver-1780480-1243648128 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1780480-1243648128.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.90 2.98 2.99 3/98 20540
/proc/meminfo: memFree=3067700/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=3736 CPUtime=0.01
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 708 0 0 0 0 1 0 0 18 0 5 0 946389667 3825664 665 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 934 669 63 164 0 769 0
[pid=20540/tid=20541] ppid=20538 vsize=3736 CPUtime=0
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 946389667 3825664 701 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=3736 CPUtime=0.01
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 119 0 0 0 0 1 0 0 19 0 5 0 946389667 3825664 706 4294967295 134512640 135180984 3217452992 3086700836 134583077 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=3736 CPUtime=0
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 517 0 0 0 0 0 0 0 19 0 5 0 946389667 3825664 711 4294967295 134512640 135180984 3217452992 3086635300 134583077 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=3736 CPUtime=0
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 946389667 3825664 712 4294967295 134512640 135180984 3217452992 3086570308 134705812 0 0 0 0 0 0 0 -1 3 0 0 0

[startup+0.051271 s]
/proc/loadavg: 2.90 2.98 2.99 3/98 20540
/proc/meminfo: memFree=3067700/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=76748 CPUtime=0.11
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 14988 0 0 0 1 10 0 0 18 0 5 0 946389667 78589952 14940 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 16030 15176 63 164 0 15865 0
[pid=20540/tid=20541] ppid=20538 vsize=64120 CPUtime=0
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 946389667 65658880 15277 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=64336 CPUtime=0.04
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 4918 0 0 0 0 4 0 0 19 0 5 0 946389667 65880064 15368 4294967295 134512640 135180984 3217452992 3086700616 134675846 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=64336 CPUtime=0.05
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 5588 0 0 0 1 4 0 0 19 0 5 0 946389667 65880064 15396 4294967295 134512640 135180984 3217452992 3086635208 134673316 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=64720 CPUtime=0.02
/proc/20540/task/20544/stat : 20544 (satake) S 20538 20540 30957 0 -1 4202560 4819 0 0 0 0 2 0 0 20 0 5 0 946389667 66273280 15441 4294967295 134512640 135180984 3217452992 3086569668 134579486 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 76748

[startup+0.120862 s]
/proc/loadavg: 2.90 2.98 2.99 3/98 20540
/proc/meminfo: memFree=3067700/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=123452 CPUtime=0.3
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 26616 0 0 0 15 15 0 0 18 0 5 0 946389667 126414848 26554 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 30863 26554 63 164 0 30698 0
[pid=20540/tid=20541] ppid=20538 vsize=123452 CPUtime=0
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 946389667 126414848 26554 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=123452 CPUtime=0.11
/proc/20540/task/20542/stat : 20542 (satake) D 20538 20540 30957 0 -1 4202560 8653 0 0 0 5 6 0 0 19 0 5 0 946389667 126414848 26554 4294967295 134512640 135180984 3217452992 3086700724 134706046 0 0 0 0 3223098951 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=123452 CPUtime=0.11
/proc/20540/task/20543/stat : 20543 (satake) D 20538 20540 30957 0 -1 4202560 9276 0 0 0 4 7 0 0 19 0 5 0 946389667 126414848 26554 4294967295 134512640 135180984 3217452992 3086635080 134675846 0 0 0 0 3223098951 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=123452 CPUtime=0.08
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 8569 0 0 0 6 2 0 0 20 0 5 0 946389667 126414848 26554 4294967295 134512640 135180984 3217452992 3086569728 134522388 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 123452

[startup+0.321811 s]
/proc/loadavg: 2.90 2.98 2.99 3/98 20540
/proc/meminfo: memFree=3067700/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=161036 CPUtime=0.89
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 33189 0 0 0 70 19 0 0 18 0 5 0 946389667 164900864 33127 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 40259 33234 63 164 0 40094 0
[pid=20540/tid=20541] ppid=20538 vsize=161036 CPUtime=0
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 946389667 164900864 33234 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=161036 CPUtime=0.32
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 10961 0 0 0 24 8 0 0 17 0 5 0 946389667 164900864 33235 4294967295 134512640 135180984 3217452992 3086700508 134702260 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=161036 CPUtime=0.31
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 11132 0 0 0 24 7 0 0 18 0 5 0 946389667 164900864 33241 4294967295 134512640 135180984 3217452992 3086635156 134579745 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=161168 CPUtime=0.3
/proc/20540/task/20544/stat : 20544 (satake) S 20538 20540 30957 0 -1 4202560 11130 0 0 0 26 4 0 0 18 0 5 0 946389667 165036032 33351 4294967295 134512640 135180984 3217452992 3086569620 134579486 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.89
Current children cumulated vsize (KiB) 161036

[startup+0.710627 s]
/proc/loadavg: 2.90 2.98 2.99 3/98 20540
/proc/meminfo: memFree=3067700/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=186740 CPUtime=2.03
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 40106 0 0 0 180 23 0 0 18 0 5 0 946389667 191221760 40044 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 46685 40045 63 164 0 46520 0
[pid=20540/tid=20541] ppid=20538 vsize=186740 CPUtime=0
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 946389667 191221760 40046 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=186740 CPUtime=0.69
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 13273 0 0 0 59 10 0 0 16 0 5 0 946389667 191221760 40047 4294967295 134512640 135180984 3217452992 3086700516 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=186740 CPUtime=0.68
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 13357 0 0 0 60 8 0 0 17 0 5 0 946389667 191221760 40047 4294967295 134512640 135180984 3217452992 3086635232 134520035 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=186740 CPUtime=0.67
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 13361 0 0 0 62 5 0 0 16 0 5 0 946389667 191221760 40047 4294967295 134512640 135180984 3217452992 3086569728 134519833 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.03
Current children cumulated vsize (KiB) 186740

[startup+1.51057 s]
/proc/loadavg: 2.90 2.98 2.99 4/103 20545
/proc/meminfo: memFree=2880548/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=220216 CPUtime=4.4
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 54049 0 0 0 407 33 0 0 18 0 5 0 946389667 225501184 49283 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 55054 49283 66 164 0 54889 0
[pid=20540/tid=20541] ppid=20538 vsize=220216 CPUtime=0
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 946389667 225501184 49283 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=220216 CPUtime=1.49
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 17915 0 0 0 134 15 0 0 16 0 5 0 946389667 225501184 49283 4294967295 134512640 135180984 3217452992 3086700816 134521016 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=220216 CPUtime=1.48
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 17881 0 0 0 138 10 0 0 16 0 5 0 946389667 225501184 49283 4294967295 134512640 135180984 3217452992 3086635000 134519080 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=220216 CPUtime=1.44
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 18135 0 0 0 136 8 0 0 16 0 5 0 946389667 225501184 49283 4294967295 134512640 135180984 3217452992 3086569680 134520716 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.4
Current children cumulated vsize (KiB) 220216

[startup+3.11043 s]
/proc/loadavg: 2.90 2.98 2.99 4/103 20545
/proc/meminfo: memFree=2901120/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=189776 CPUtime=9.24
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 56204 0 0 0 886 38 0 0 18 0 5 0 946389667 194330624 42030 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 47444 42030 68 164 0 47279 0
[pid=20540/tid=20541] ppid=20538 vsize=189776 CPUtime=0.09
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 1681 0 0 0 8 1 0 0 16 0 5 0 946389667 194330624 42030 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=189776 CPUtime=3.09
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 18070 0 0 0 293 16 0 0 17 0 5 0 946389667 194330624 42030 4294967295 134512640 135180984 3217452992 3086700400 134528267 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=189776 CPUtime=3.05
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 18044 0 0 0 293 12 0 0 17 0 5 0 946389667 194330624 42030 4294967295 134512640 135180984 3217452992 3086634800 134523862 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=189776 CPUtime=3.02
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 18298 0 0 0 293 9 0 0 17 0 5 0 946389667 194330624 42030 4294967295 134512640 135180984 3217452992 3086569328 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 9.24
Current children cumulated vsize (KiB) 189776

[startup+6.31017 s]
/proc/loadavg: 2.91 2.98 2.99 4/103 20545
/proc/meminfo: memFree=2900532/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=190444 CPUtime=18.91
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 56387 0 0 0 1840 51 0 0 18 0 5 0 946389667 195014656 42213 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 47611 42213 68 164 0 47446 0
[pid=20540/tid=20541] ppid=20538 vsize=190444 CPUtime=0.16
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 1684 0 0 0 8 8 0 0 16 0 5 0 946389667 195014656 42213 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=190444 CPUtime=6.29
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 18124 0 0 0 613 16 0 0 22 0 5 0 946389667 195014656 42213 4294967295 134512640 135180984 3217452992 3086700400 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=190444 CPUtime=6.25
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 18113 0 0 0 610 15 0 0 23 0 5 0 946389667 195014656 42213 4294967295 134512640 135180984 3217452992 3086634928 134532454 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=190444 CPUtime=6.22
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 18355 0 0 0 610 12 0 0 22 0 5 0 946389667 195014656 42213 4294967295 134512640 135180984 3217452992 3086569320 134520863 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18.91
Current children cumulated vsize (KiB) 190444

[startup+12.7097 s]
/proc/loadavg: 2.92 2.98 2.99 4/103 20546
/proc/meminfo: memFree=2899324/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=191940 CPUtime=38.28
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 56743 0 0 0 3752 76 0 0 18 0 5 0 946389667 196546560 42569 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 47985 42569 68 164 0 47820 0
[pid=20540/tid=20541] ppid=20538 vsize=191940 CPUtime=0.33
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 1693 0 0 0 10 23 0 0 16 0 5 0 946389667 196546560 42569 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=191940 CPUtime=12.69
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 18246 0 0 0 1252 17 0 0 25 0 5 0 946389667 196546560 42569 4294967295 134512640 135180984 3217452992 3086700336 134523728 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=191940 CPUtime=12.65
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 18252 0 0 0 1244 21 0 0 25 0 5 0 946389667 196546560 42569 4294967295 134512640 135180984 3217452992 3086634696 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=191940 CPUtime=12.62
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 18441 0 0 0 1247 15 0 0 25 0 5 0 946389667 196546560 42569 4294967295 134512640 135180984 3217452992 3086569344 134532624 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38.28
Current children cumulated vsize (KiB) 191940

[startup+25.5086 s]
/proc/loadavg: 2.93 2.98 2.99 4/103 20547
/proc/meminfo: memFree=2892352/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=198456 CPUtime=76.87
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 58490 0 0 0 7577 110 0 0 18 0 5 0 946389667 203218944 44316 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 49614 44316 68 164 0 49449 0
[pid=20540/tid=20541] ppid=20538 vsize=198456 CPUtime=0.54
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 1715 0 0 0 14 40 0 0 16 0 5 0 946389667 203218944 44316 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=198456 CPUtime=25.48
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 18841 0 0 0 2526 22 0 0 25 0 5 0 946389667 203218944 44316 4294967295 134512640 135180984 3217452992 3086700400 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=198456 CPUtime=25.45
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 18719 0 0 0 2519 26 0 0 25 0 5 0 946389667 203218944 44316 4294967295 134512640 135180984 3217452992 3086634864 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=198456 CPUtime=25.41
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 19104 0 0 0 2519 22 0 0 25 0 5 0 946389667 203218944 44316 4294967295 134512640 135180984 3217452992 3086569328 134528680 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 76.87
Current children cumulated vsize (KiB) 198456

[startup+51.1065 s]
/proc/loadavg: 2.95 2.98 2.99 4/103 20732
/proc/meminfo: memFree=2873696/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=217204 CPUtime=153.86
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 63045 0 0 0 15235 151 0 0 18 0 5 0 946389667 222416896 48871 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 54301 48871 68 164 0 54136 0
[pid=20540/tid=20541] ppid=20538 vsize=217204 CPUtime=0.84
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 1760 0 0 0 22 62 0 0 16 0 5 0 946389667 222416896 48871 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=217204 CPUtime=51.06
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 20822 0 0 0 5081 25 0 0 25 0 5 0 946389667 222416896 48871 4294967295 134512640 135180984 3217452992 3086700300 134519104 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=217204 CPUtime=51.02
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 19897 0 0 0 5070 32 0 0 25 0 5 0 946389667 222416896 48871 4294967295 134512640 135180984 3217452992 3086634764 134519095 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=217204 CPUtime=50.95
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 20455 0 0 0 5063 32 0 0 25 0 5 0 946389667 222416896 48871 4294967295 134512640 135180984 3217452992 3086569320 134520863 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 153.86
Current children cumulated vsize (KiB) 217204

[startup+102.312 s]
/proc/loadavg: 2.98 2.98 2.99 4/103 20736

################
# More data... #
################

[pid=20540/tid=20542] ppid=20538 vsize=446956 CPUtime=522.13
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 49620 0 0 0 52141 72 0 0 25 0 5 0 946389667 457682944 106634 4294967295 134512640 135180984 3217452992 3086700392 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=446956 CPUtime=522.07
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 34247 0 0 0 52113 94 0 0 25 0 5 0 946389667 457682944 106634 4294967295 134512640 135180984 3217452992 3086634696 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=446956 CPUtime=521.83
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 34795 0 0 0 52084 99 0 0 25 0 5 0 946389667 457682944 106634 4294967295 134512640 135180984 3217452992 3086569392 134532425 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1568.59
Current children cumulated vsize (KiB) 446956

[startup+582.303 s]
/proc/loadavg: 3.00 3.00 3.00 4/103 22249
/proc/meminfo: memFree=2617792/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=473444 CPUtime=1748.67
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 126938 0 0 0 174380 487 0 0 18 0 5 0 946389667 484806656 112764 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 118361 112764 68 164 0 118196 0
[pid=20540/tid=20541] ppid=20538 vsize=473444 CPUtime=2.76
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 2073 0 0 0 69 207 0 0 15 0 5 0 946389667 484806656 112764 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=473444 CPUtime=582.13
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 52912 0 0 0 58138 75 0 0 25 0 5 0 946389667 484806656 112764 4294967295 134512640 135180984 3217452992 3086700400 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=473444 CPUtime=582.04
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 35839 0 0 0 58103 101 0 0 25 0 5 0 946389667 484806656 112764 4294967295 134512640 135180984 3217452992 3086634864 134528267 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=473444 CPUtime=581.75
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 36003 0 0 0 58071 104 0 0 25 0 5 0 946389667 484806656 112764 4294967295 134512640 135180984 3217452992 3086569252 134521149 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1748.67
Current children cumulated vsize (KiB) 473444

[startup+642.318 s]
/proc/loadavg: 3.00 3.00 3.00 4/103 22436
/proc/meminfo: memFree=2604920/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=486592 CPUtime=1928.88
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 130132 0 0 0 192380 508 0 0 18 0 5 0 946389667 498270208 115958 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 121648 115958 68 164 0 121483 0
[pid=20540/tid=20541] ppid=20538 vsize=486592 CPUtime=2.95
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 2092 0 0 0 77 218 0 0 16 0 5 0 946389667 498270208 115958 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=486592 CPUtime=642.14
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 54337 0 0 0 64135 79 0 0 25 0 5 0 946389667 498270208 115958 4294967295 134512640 135180984 3217452992 3086700392 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=486592 CPUtime=642.06
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 36900 0 0 0 64103 103 0 0 25 0 5 0 946389667 498270208 115958 4294967295 134512640 135180984 3217452992 3086634864 134528267 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=486592 CPUtime=641.73
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 36692 0 0 0 64065 108 0 0 25 0 5 0 946389667 498270208 115958 4294967295 134512640 135180984 3217452992 3086569328 134526712 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1928.88
Current children cumulated vsize (KiB) 486592

[startup+702.313 s]
/proc/loadavg: 3.00 3.00 3.00 4/103 22624
/proc/meminfo: memFree=2583196/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=507240 CPUtime=2108.73
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 135476 0 0 0 210338 535 0 0 18 0 5 0 946389667 519413760 121302 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 126810 121302 68 164 0 126645 0
[pid=20540/tid=20541] ppid=20538 vsize=507240 CPUtime=3.1
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 2131 0 0 0 83 227 0 0 15 0 5 0 946389667 519413760 121302 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=507240 CPUtime=702.08
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 56632 0 0 0 70122 86 0 0 25 0 5 0 946389667 519413760 121302 4294967295 134512640 135180984 3217452992 3086700304 134525166 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=507240 CPUtime=702.03
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 38695 0 0 0 70093 110 0 0 25 0 5 0 946389667 519413760 121302 4294967295 134512640 135180984 3217452992 3086634856 134519901 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=507240 CPUtime=701.53
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 37907 0 0 0 70041 112 0 0 25 0 5 0 946389667 519413760 121302 4294967295 134512640 135180984 3217452992 3086569324 134519884 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2108.73
Current children cumulated vsize (KiB) 507240

[startup+762.318 s]
/proc/loadavg: 3.00 3.00 3.00 4/103 22812
/proc/meminfo: memFree=2566604/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=523560 CPUtime=2288.69
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 139718 0 0 0 228311 558 0 0 18 0 5 0 946389667 536125440 125544 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 130890 125544 68 164 0 130725 0
[pid=20540/tid=20541] ppid=20538 vsize=523560 CPUtime=3.23
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 2168 0 0 0 89 234 0 0 15 0 5 0 946389667 536125440 125544 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=523560 CPUtime=762.06
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 58448 0 0 0 76112 94 0 0 25 0 5 0 946389667 536125440 125544 4294967295 134512640 135180984 3217452992 3086700392 134518255 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=523560 CPUtime=762.03
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 40124 0 0 0 76089 114 0 0 25 0 5 0 946389667 536125440 125544 4294967295 134512640 135180984 3217452992 3086634928 134532445 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=523560 CPUtime=761.38
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 38867 0 0 0 76022 116 0 0 25 0 5 0 946389667 536125440 125544 4294967295 134512640 135180984 3217452992 3086569328 134528688 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2288.69
Current children cumulated vsize (KiB) 523560

[startup+822.313 s]
/proc/loadavg: 3.00 3.00 3.00 4/103 23000
/proc/meminfo: memFree=2549004/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=542192 CPUtime=2468.62
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 144155 0 0 0 246283 579 0 0 18 0 5 0 946389667 555204608 129981 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 135548 129981 68 164 0 135383 0
[pid=20540/tid=20541] ppid=20538 vsize=542192 CPUtime=3.33
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 2201 0 0 0 93 240 0 0 16 0 5 0 946389667 555204608 129981 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=542192 CPUtime=822.04
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 60329 0 0 0 82100 104 0 0 25 0 5 0 946389667 555204608 129981 4294967295 134512640 135180984 3217452992 3086700272 134522614 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=542192 CPUtime=822.01
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 41674 0 0 0 82084 117 0 0 25 0 5 0 946389667 555204608 129981 4294967295 134512640 135180984 3217452992 3086634856 134520863 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=542192 CPUtime=821.25
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 39840 0 0 0 82007 118 0 0 25 0 5 0 946389667 555204608 129981 4294967295 134512640 135180984 3217452992 3086569320 134520863 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2468.62
Current children cumulated vsize (KiB) 542192

[startup+882.309 s]
/proc/loadavg: 3.00 3.00 3.00 4/103 23188
/proc/meminfo: memFree=2530548/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=560196 CPUtime=2648.54
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 148650 0 0 0 264238 616 0 0 18 0 5 0 946389667 573640704 134476 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 140049 134476 68 164 0 139884 0
[pid=20540/tid=20541] ppid=20538 vsize=560196 CPUtime=3.55
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 2281 0 0 0 101 254 0 0 16 0 5 0 946389667 573640704 134476 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=560196 CPUtime=882.02
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 62349 0 0 0 88087 115 0 0 25 0 5 0 946389667 573640704 134476 4294967295 134512640 135180984 3217452992 3086700400 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=560196 CPUtime=881.98
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 43273 0 0 0 88074 124 0 0 25 0 5 0 946389667 573640704 134476 4294967295 134512640 135180984 3217452992 3086634696 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=560196 CPUtime=881
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 40636 0 0 0 87977 123 0 0 25 0 5 0 946389667 573640704 134476 4294967295 134512640 135180984 3217452992 3086569264 134523615 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2648.54
Current children cumulated vsize (KiB) 560196

[startup+942.304 s]
/proc/loadavg: 3.05 3.01 3.00 4/103 23379
/proc/meminfo: memFree=2515368/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=576348 CPUtime=2828.46
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 152579 0 0 0 282208 638 0 0 18 0 5 0 946389667 590180352 138405 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 144087 138405 68 164 0 143922 0
[pid=20540/tid=20541] ppid=20538 vsize=576348 CPUtime=3.67
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 2357 0 0 0 102 265 0 0 16 0 5 0 946389667 590180352 138405 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=576348 CPUtime=942.02
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 64324 0 0 0 94084 118 0 0 25 0 5 0 946389667 590180352 138405 4294967295 134512640 135180984 3217452992 3086700392 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=576348 CPUtime=941.96
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 44296 0 0 0 94067 129 0 0 25 0 5 0 946389667 590180352 138405 4294967295 134512640 135180984 3217452992 3086634864 134526529 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=576348 CPUtime=940.82
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 41491 0 0 0 93956 126 0 0 25 0 5 0 946389667 590180352 138405 4294967295 134512640 135180984 3217452992 3086569296 134519935 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2828.46
Current children cumulated vsize (KiB) 576348



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.02 s]
/proc/loadavg: 3.02 3.01 3.00 4/103 23567
/proc/meminfo: memFree=2499652/3368532 swapFree=1959840/1959888
[pid=20540] ppid=20538 vsize=590376 CPUtime=3001.52
/proc/20540/stat : 20540 (satake) S 20538 20540 30957 0 -1 4202496 156371 0 0 0 299483 669 0 0 18 0 5 0 946389667 604545024 142197 4294967295 134512640 135180984 3217452992 3217452428 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20540/statm: 147594 142197 68 164 0 147429 0
[pid=20540/tid=20541] ppid=20538 vsize=590376 CPUtime=3.9
/proc/20540/task/20541/stat : 20541 (satake) S 20538 20540 30957 0 -1 4202560 2433 0 0 0 111 279 0 0 16 0 5 0 946389667 604545024 142197 4294967295 134512640 135180984 3217452992 3086766096 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20540/tid=20542] ppid=20538 vsize=590376 CPUtime=999.69
/proc/20540/task/20542/stat : 20542 (satake) R 20538 20540 30957 0 -1 4202560 66216 0 0 0 99845 124 0 0 25 0 5 0 946389667 604545024 142197 4294967295 134512640 135180984 3217452992 3086700400 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20540/tid=20543] ppid=20538 vsize=590376 CPUtime=999.65
/proc/20540/task/20543/stat : 20543 (satake) R 20538 20540 30957 0 -1 4202560 45012 0 0 0 99831 134 0 0 25 0 5 0 946389667 604545024 142197 4294967295 134512640 135180984 3217452992 3086634696 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20540/tid=20544] ppid=20538 vsize=590376 CPUtime=998.28
/proc/20540/task/20544/stat : 20544 (satake) R 20538 20540 30957 0 -1 4202560 42599 0 0 0 99696 132 0 0 25 0 5 0 946389667 604545024 142197 4294967295 134512640 135180984 3217452992 3086569328 134528267 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3001.52
Current children cumulated vsize (KiB) 590376

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.07
CPU time (s): 3001.6
CPU user time (s): 2994.87
CPU system time (s): 6.73
CPU usage (%): 300.139
Max. virtual memory (cumulated for all children) (KiB): 590376

deleting IPC queue 13107200
deleting IPC queue 13139969
deleting IPC queue 13172738
deleting IPC queue 13205507
deleting IPC queue 13238276
deleting IPC queue 13271045
deleting IPC queue 13303814
deleting IPC queue 13336583
deleting IPC queue 13369352
deleting IPC queue 13402121
deleting IPC queue 13434890
deleting IPC queue 13467659
deleting IPC queue 13500428
deleting IPC queue 13533197
deleting IPC queue 13565966
deleting IPC queue 13598735

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2994.87
system time used= 6.73
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 156371
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 246887
involuntary context switches= 95395

runsolver used 0.01 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi39 at 2009-05-30 03:48:48
IDJOB=1780480
IDBENCH=71010
IDSOLVER=629
FILE ID=tipi39/1780480-1243648128
PBS_JOBID=
Free space on /tmp= 5725 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UCG-15-10p1.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780480-1243648128/watcher-1780480-1243648128 -o /tmp/evaluation-result-1780480-1243648128/solver-1780480-1243648128 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1780480-1243648128.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 484dad50fb275faff8eff92c4d5447cb
RANDOM SEED= 1689956134

Linux tipi39 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3068144 kB
Buffers:         57320 kB
Cached:         138696 kB
SwapCached:          0 kB
Active:         109268 kB
Inactive:       102852 kB
HighTotal:     2489216 kB
HighFree:      2336900 kB
LowTotal:       879316 kB
LowFree:        731244 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:           19896 kB
Writeback:           0 kB
AnonPages:       16164 kB
Mapped:           6276 kB
Slab:            77624 kB
SReclaimable:    67240 kB
SUnreclaim:      10384 kB
PageTables:        532 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:    94804 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 5725 MiB
End job on tipi39 at 2009-05-30 04:05:31