Trace number 1777000

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 3007.72 1000.06

General information on the benchmark

Namemizh-md5-48-5.cnf
MD5SUM8ab50418497c0326ed1ff5d73a4e24a3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1504.44
Satisfiable
(Un)Satisfiability was proved
Number of variables66892
Number of clauses279256
Sum of the clauses size832648
Maximum clause length4
Minimum clause length1
Number of clauses of size 1201
Number of clauses of size 2120496
Number of clauses of size 342781
Number of clauses of size 4115778
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1777000-1243639578/watcher-1777000-1243639578 -o /tmp/evaluation-result-1777000-1243639578/solver-1777000-1243639578 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1777000-1243639578.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 3.00 3.01 2.97 3/98 25406
/proc/meminfo: memFree=3108616/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=5260 CPUtime=0
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 679 0 0 0 0 0 0 0 18 0 5 0 945534537 5386240 635 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 1315 639 63 164 0 1150 0
[pid=25406/tid=25407] ppid=25404 vsize=5260 CPUtime=0
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 945534537 5386240 667 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=5260 CPUtime=0
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 598 0 0 0 0 0 0 0 19 0 5 0 945534537 5386240 672 4294967295 134512640 135180984 3215158672 3086901540 134583077 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=5260 CPUtime=0
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 5 0 945534537 5386240 677 4294967295 134512640 135180984 3215158672 3086836548 134705812 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=5260 CPUtime=0
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 945534537 5386240 682 4294967295 134512640 135180984 3215158672 3086771012 134705812 0 0 0 0 0 0 0 -1 3 0 0 0

[startup+0.049416 s]
/proc/loadavg: 3.00 3.01 2.97 3/98 25406
/proc/meminfo: memFree=3108616/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=22892 CPUtime=0.06
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 5120 0 0 0 5 1 0 0 18 0 5 0 945534537 23441408 5072 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 5723 5072 63 164 0 5558 0
[pid=25406/tid=25407] ppid=25404 vsize=22892 CPUtime=0
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 945534537 23441408 5073 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=22892 CPUtime=0.03
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 1860 0 0 0 3 0 0 0 19 0 5 0 945534537 23441408 5073 4294967295 134512640 135180984 3215158672 3086901472 134522706 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=22892 CPUtime=0.02
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 1693 0 0 0 2 0 0 0 19 0 5 0 945534537 23441408 5073 4294967295 134512640 135180984 3215158672 3086835800 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=22892 CPUtime=0.01
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 1450 0 0 0 0 1 0 0 21 0 5 0 945534537 23441408 5073 4294967295 134512640 135180984 3215158672 3086770432 134522207 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 22892

[startup+0.109683 s]
/proc/loadavg: 3.00 3.01 2.97 3/98 25406
/proc/meminfo: memFree=3108616/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=32424 CPUtime=0.24
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 7343 0 0 0 22 2 0 0 18 0 5 0 945534537 33202176 7282 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 8106 7282 63 164 0 7941 0
[pid=25406/tid=25407] ppid=25404 vsize=32424 CPUtime=0
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 945534537 33202176 7282 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=32424 CPUtime=0.09
/proc/25406/task/25408/stat : 25408 (satake) D 25404 25406 30957 0 -1 4202560 2537 0 0 0 8 1 0 0 19 0 5 0 945534537 33202176 7282 4294967295 134512640 135180984 3215158672 3086901312 134702260 0 0 0 0 3223098951 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=32424 CPUtime=0.08
/proc/25406/task/25409/stat : 25409 (satake) D 25404 25406 30957 0 -1 4202560 2512 0 0 0 8 0 0 0 19 0 5 0 945534537 33202176 7282 4294967295 134512640 135180984 3215158672 3086835808 134691935 0 0 0 0 3223098951 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=32424 CPUtime=0.07
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 2176 0 0 0 6 1 0 0 20 0 5 0 945534537 33202176 7282 4294967295 134512640 135180984 3215158672 3086770256 134702260 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 32424

[startup+0.3094 s]
/proc/loadavg: 3.00 3.01 2.97 3/98 25406
/proc/meminfo: memFree=3108616/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=68996 CPUtime=0.8
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 14734 0 0 0 72 8 0 0 18 0 5 0 945534537 70651904 14666 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 17249 14666 63 164 0 17084 0
[pid=25406/tid=25407] ppid=25404 vsize=68996 CPUtime=0
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 945534537 70651904 14667 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=68996 CPUtime=0.28
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 5051 0 0 0 23 5 0 0 17 0 5 0 945534537 70651904 14669 4294967295 134512640 135180984 3215158672 3086901336 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=68996 CPUtime=0.26
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 4973 0 0 0 25 1 0 0 17 0 5 0 945534537 70651904 14670 4294967295 134512640 135180984 3215158672 3086835952 134522560 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=68996 CPUtime=0.26
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 4596 0 0 0 24 2 0 0 19 0 5 0 945534537 70651904 14671 4294967295 134512640 135180984 3215158672 3086770480 134534891 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.8
Current children cumulated vsize (KiB) 68996

[startup+0.709367 s]
/proc/loadavg: 3.00 3.01 2.97 3/98 25406
/proc/meminfo: memFree=3108616/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=68340 CPUtime=1.98
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 16870 0 0 0 179 19 0 0 18 0 5 0 945534537 69980160 12680 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 17085 12680 68 164 0 16920 0
[pid=25406/tid=25407] ppid=25404 vsize=68340 CPUtime=0.09
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 1171 0 0 0 4 5 0 0 16 0 5 0 945534537 69980160 12680 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=68340 CPUtime=0.59
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 5143 0 0 0 53 6 0 0 17 0 5 0 945534537 69980160 12680 4294967295 134512640 135180984 3215158672 3086901104 134528967 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=68340 CPUtime=0.65
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 5217 0 0 0 62 3 0 0 17 0 5 0 945534537 69980160 12680 4294967295 134512640 135180984 3215158672 3086835460 134579745 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=68340 CPUtime=0.65
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 5228 0 0 0 60 5 0 0 18 0 5 0 945534537 69980160 12680 4294967295 134512640 135180984 3215158672 3086770028 134520854 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.98
Current children cumulated vsize (KiB) 68340

[startup+1.5093 s]
/proc/loadavg: 3.08 3.03 2.98 5/103 25411
/proc/meminfo: memFree=3058856/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=70212 CPUtime=4.36
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 17344 0 0 0 376 60 0 0 18 0 5 0 945534537 71897088 13154 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 17553 13154 68 164 0 17388 0
[pid=25406/tid=25407] ppid=25404 vsize=70212 CPUtime=0.36
/proc/25406/task/25407/stat : 25407 (satake) R 25404 25406 30957 0 -1 4202560 1247 0 0 0 12 24 0 0 15 0 5 0 945534537 71897088 13154 4294967295 134512640 135180984 3215158672 3086966812 134706407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=70212 CPUtime=1.38
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 5259 0 0 0 124 14 0 0 18 0 5 0 945534537 71897088 13154 4294967295 134512640 135180984 3215158672 3086901096 134520863 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=70212 CPUtime=1.19
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 5334 0 0 0 112 7 0 0 18 0 5 0 945534537 71897088 13155 4294967295 134512640 135180984 3215158672 3086835364 134580588 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=70212 CPUtime=1.43
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 5393 0 0 0 128 15 0 0 18 0 5 0 945534537 71897088 13155 4294967295 134512640 135180984 3215158672 3086770024 134520884 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.36
Current children cumulated vsize (KiB) 70212

[startup+3.10917 s]
/proc/loadavg: 3.08 3.03 2.98 4/103 25411
/proc/meminfo: memFree=3056340/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=74072 CPUtime=8.95
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 18406 0 0 0 742 153 0 0 18 0 5 0 945534537 75849728 14216 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 18518 14216 68 164 0 18353 0
[pid=25406/tid=25407] ppid=25404 vsize=74072 CPUtime=0.99
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 1421 0 0 0 26 73 0 0 16 0 5 0 945534537 75849728 14216 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=74072 CPUtime=2.92
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 5514 0 0 0 264 28 0 0 19 0 5 0 945534537 75849728 14216 4294967295 134512640 135180984 3215158672 3086901040 134523641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=74072 CPUtime=2.17
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 5615 0 0 0 205 12 0 0 18 0 5 0 945534537 75849728 14216 4294967295 134512640 135180984 3215158672 3086835680 134530765 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=74072 CPUtime=2.87
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 5745 0 0 0 247 40 0 0 18 0 5 0 945534537 75849728 14216 4294967295 134512640 135180984 3215158672 3086769936 134524814 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 8.95
Current children cumulated vsize (KiB) 74072

[startup+6.30891 s]
/proc/loadavg: 3.08 3.03 2.98 4/103 25411
/proc/meminfo: memFree=3046980/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=84328 CPUtime=18.21
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 20641 0 0 0 1449 372 0 0 18 0 5 0 945534537 86351872 16451 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 21082 16451 68 164 0 20917 0
[pid=25406/tid=25407] ppid=25404 vsize=84328 CPUtime=2.48
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 1989 0 0 0 66 182 0 0 16 0 5 0 945534537 86351872 16451 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=84328 CPUtime=5.08
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 6043 0 0 0 456 52 0 0 18 0 5 0 945534537 86351872 16451 4294967295 134512640 135180984 3215158672 3086901104 134528661 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=84328 CPUtime=4.99
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 6179 0 0 0 446 53 0 0 18 0 5 0 945534537 86351872 16451 4294967295 134512640 135180984 3215158672 3086835284 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=84328 CPUtime=5.67
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 6319 0 0 0 482 85 0 0 18 0 5 0 945534537 86351872 16451 4294967295 134512640 135180984 3215158672 3086770032 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 18.21
Current children cumulated vsize (KiB) 84328

[startup+12.7084 s]
/proc/loadavg: 3.22 3.06 2.99 4/103 25412
/proc/meminfo: memFree=3039172/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=89744 CPUtime=38.82
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 21989 0 0 0 3180 702 0 0 18 0 5 0 945534537 91897856 17799 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 22436 17799 68 164 0 22271 0
[pid=25406/tid=25407] ppid=25404 vsize=89744 CPUtime=4.67
/proc/25406/task/25407/stat : 25407 (satake) R 25404 25406 30957 0 -1 4202560 2322 0 0 0 116 351 0 0 16 0 5 0 945534537 91897856 17799 4294967295 134512640 135180984 3215158672 3086966804 134580588 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=89744 CPUtime=11.3
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 6330 0 0 0 1003 127 0 0 18 0 5 0 945534537 91897856 17799 4294967295 134512640 135180984 3215158672 3086901028 134521136 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=89744 CPUtime=11.11
/proc/25406/task/25409/stat : 25409 (satake) S 25404 25406 30957 0 -1 4202560 6543 0 0 0 1006 105 0 0 18 0 5 0 945534537 91897856 17799 4294967295 134512640 135180984 3215158672 3086835360 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=89744 CPUtime=11.74
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 6683 0 0 0 1055 119 0 0 21 0 5 0 945534537 91897856 17799 4294967295 134512640 135180984 3215158672 3086769864 134675846 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38.82
Current children cumulated vsize (KiB) 89744

[startup+25.5073 s]
/proc/loadavg: 3.19 3.06 2.99 3/103 25596
/proc/meminfo: memFree=3021492/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=107700 CPUtime=76.87
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 26327 0 0 0 6572 1115 0 0 18 0 5 0 945534537 110284800 22137 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 26925 22137 68 164 0 26760 0
[pid=25406/tid=25407] ppid=25404 vsize=107700 CPUtime=7.44
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 3284 0 0 0 188 556 0 0 15 0 5 0 945534537 110284800 22137 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=107700 CPUtime=23.66
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 7510 0 0 0 2180 186 0 0 25 0 5 0 945534537 110284800 22137 4294967295 134512640 135180984 3215158672 3086901104 134528162 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=107700 CPUtime=21.54
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 7587 0 0 0 1997 157 0 0 25 0 5 0 945534537 110284800 22137 4294967295 134512640 135180984 3215158672 3086835284 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=107700 CPUtime=24.24
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 7835 0 0 0 2208 216 0 0 25 0 5 0 945534537 110284800 22137 4294967295 134512640 135180984 3215158672 3086770048 134532624 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 76.87
Current children cumulated vsize (KiB) 107700

[startup+51.1052 s]
/proc/loadavg: 3.12 3.05 2.99 4/103 25598
/proc/meminfo: memFree=2994884/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=135060 CPUtime=152.66
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 32947 0 0 0 13577 1689 0 0 18 0 5 0 945534537 138301440 28757 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 33765 28757 68 164 0 33600 0
[pid=25406/tid=25407] ppid=25404 vsize=135060 CPUtime=11.48
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 4784 0 0 0 302 846 0 0 16 0 5 0 945534537 138301440 28757 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=135060 CPUtime=47.84
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 9217 0 0 0 4523 261 0 0 25 0 5 0 945534537 138301440 28757 4294967295 134512640 135180984 3215158672 3086901104 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=135060 CPUtime=43.98
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 9184 0 0 0 4173 225 0 0 25 0 5 0 945534537 138301440 28757 4294967295 134512640 135180984 3215158672 3086835680 134531534 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=135060 CPUtime=49.37
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 9651 0 0 0 4580 357 0 0 25 0 5 0 945534537 138301440 28757 4294967295 134512640 135180984 3215158672 3086769968 134523644 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 152.66
Current children cumulated vsize (KiB) 135060

[startup+102.311 s]
/proc/loadavg: 3.08 3.06 3.00 4/103 25785

################
# More data... #
################

[pid=25406/tid=25408] ppid=25404 vsize=395580 CPUtime=514.08
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 26891 0 0 0 50673 735 0 0 25 0 5 0 945534537 405073920 93768 4294967295 134512640 135180984 3215158672 3086901096 134518255 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=395580 CPUtime=509.84
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 29573 0 0 0 50276 708 0 0 25 0 5 0 945534537 405073920 93768 4294967295 134512640 135180984 3215158672 3086835472 134525084 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=395580 CPUtime=518.39
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 32282 0 0 0 50842 997 0 0 25 0 5 0 945534537 405073920 93768 4294967295 134512640 135180984 3215158672 3086770032 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1573.97
Current children cumulated vsize (KiB) 395580

[startup+582.312 s]
/proc/loadavg: 3.04 3.06 3.00 4/103 27294
/proc/meminfo: memFree=2733016/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=395580 CPUtime=1754.9
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 97974 0 0 0 170438 5052 0 0 18 0 5 0 945534537 405073920 93784 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 98895 93784 68 164 0 98730 0
[pid=25406/tid=25407] ppid=25404 vsize=395580 CPUtime=33.06
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 9117 0 0 0 808 2498 0 0 16 0 5 0 945534537 405073920 93784 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=395580 CPUtime=573.95
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 26891 0 0 0 56613 782 0 0 25 0 5 0 945534537 405073920 93784 4294967295 134512640 135180984 3215158672 3086901072 134519935 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=395580 CPUtime=569.79
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 29573 0 0 0 56222 757 0 0 25 0 5 0 945534537 405073920 93784 4294967295 134512640 135180984 3215158672 3086835568 134528554 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=395580 CPUtime=578.1
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 32282 0 0 0 56795 1015 0 0 25 0 5 0 945534537 405073920 93784 4294967295 134512640 135180984 3215158672 3086770028 134518208 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1754.9
Current children cumulated vsize (KiB) 395580

[startup+642.307 s]
/proc/loadavg: 3.01 3.04 3.00 4/103 27485
/proc/meminfo: memFree=2732436/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=395580 CPUtime=1935.29
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 97987 0 0 0 188274 5255 0 0 18 0 5 0 945534537 405073920 93797 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 98895 93797 68 164 0 98730 0
[pid=25406/tid=25407] ppid=25404 vsize=395580 CPUtime=34.37
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 9130 0 0 0 837 2600 0 0 16 0 5 0 945534537 405073920 93797 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=395580 CPUtime=633.84
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 26891 0 0 0 62562 822 0 0 25 0 5 0 945534537 405073920 93797 4294967295 134512640 135180984 3215158672 3086900976 134522694 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=395580 CPUtime=629.69
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 29573 0 0 0 62171 798 0 0 25 0 5 0 945534537 405073920 93797 4294967295 134512640 135180984 3215158672 3086835472 134525183 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=395580 CPUtime=637.39
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 32282 0 0 0 62704 1035 0 0 25 0 5 0 945534537 405073920 93797 4294967295 134512640 135180984 3215158672 3086770028 134518208 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1935.29
Current children cumulated vsize (KiB) 395580

[startup+702.312 s]
/proc/loadavg: 3.00 3.03 3.00 4/103 27673
/proc/meminfo: memFree=2727204/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=404100 CPUtime=2115.47
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 99879 0 0 0 206151 5396 0 0 18 0 5 0 945534537 413798400 95689 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 101025 95689 68 164 0 100860 0
[pid=25406/tid=25407] ppid=25404 vsize=404100 CPUtime=35.15
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 9246 0 0 0 853 2662 0 0 15 0 5 0 945534537 413798400 95689 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=404100 CPUtime=693.76
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 27419 0 0 0 68530 846 0 0 25 0 5 0 945534537 413798400 95689 4294967295 134512640 135180984 3215158672 3086901168 134532445 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=404100 CPUtime=689.17
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 30253 0 0 0 68090 827 0 0 25 0 5 0 945534537 413798400 95689 4294967295 134512640 135180984 3215158672 3086835568 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=404100 CPUtime=697.39
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 32850 0 0 0 68678 1061 0 0 25 0 5 0 945534537 413798400 95689 4294967295 134512640 135180984 3215158672 3086770032 134528180 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2115.47
Current children cumulated vsize (KiB) 404100

[startup+762.317 s]
/proc/loadavg: 3.00 3.03 3.00 4/103 27861
/proc/meminfo: memFree=2693592/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=436644 CPUtime=2295.18
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 108130 0 0 0 223933 5585 0 0 18 0 5 0 945534537 447123456 103940 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 109161 103940 68 164 0 108996 0
[pid=25406/tid=25407] ppid=25404 vsize=436644 CPUtime=36.42
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 9834 0 0 0 890 2752 0 0 16 0 5 0 945534537 447123456 103940 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=436644 CPUtime=753.49
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 29797 0 0 0 74470 879 0 0 25 0 5 0 945534537 447123456 103940 4294967295 134512640 135180984 3215158672 3086900936 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=436644 CPUtime=747.95
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 32732 0 0 0 73947 848 0 0 25 0 5 0 945534537 447123456 103940 4294967295 134512640 135180984 3215158672 3086835568 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=436644 CPUtime=757.33
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 35656 0 0 0 74627 1106 0 0 25 0 5 0 945534537 447123456 103940 4294967295 134512640 135180984 3215158672 3086770032 134526629 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2295.18
Current children cumulated vsize (KiB) 436644

[startup+822.302 s]
/proc/loadavg: 3.00 3.02 3.00 4/103 28049
/proc/meminfo: memFree=2662484/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=467592 CPUtime=2474.98
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 115958 0 0 0 241794 5704 0 0 18 0 5 0 945534537 478814208 111768 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 116898 111768 68 164 0 116733 0
[pid=25406/tid=25407] ppid=25404 vsize=467592 CPUtime=37.14
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 10112 0 0 0 911 2803 0 0 16 0 5 0 945534537 478814208 111768 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=467592 CPUtime=813.37
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 32260 0 0 0 80440 897 0 0 25 0 5 0 945534537 478814208 111768 4294967295 134512640 135180984 3215158672 3086901104 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=467592 CPUtime=807.19
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 35349 0 0 0 79851 868 0 0 25 0 5 0 945534537 478814208 111768 4294967295 134512640 135180984 3215158672 3086835568 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=467592 CPUtime=817.29
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 38126 0 0 0 80593 1136 0 0 25 0 5 0 945534537 478814208 111768 4294967295 134512640 135180984 3215158672 3086769928 134518214 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2474.98
Current children cumulated vsize (KiB) 467592

[startup+882.307 s]
/proc/loadavg: 3.00 3.01 3.00 4/103 28237
/proc/meminfo: memFree=2630768/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=499172 CPUtime=2654.77
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 123754 0 0 0 259678 5799 0 0 18 0 5 0 945534537 511152128 119564 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 124793 119564 68 164 0 124628 0
[pid=25406/tid=25407] ppid=25404 vsize=499172 CPUtime=37.68
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 10340 0 0 0 923 2845 0 0 16 0 5 0 945534537 511152128 119564 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=499172 CPUtime=873.25
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 34646 0 0 0 86404 921 0 0 25 0 5 0 945534537 511152128 119564 4294967295 134512640 135180984 3215158672 3086901040 134523696 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=499172 CPUtime=866.63
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 37813 0 0 0 85787 876 0 0 25 0 5 0 945534537 511152128 119564 4294967295 134512640 135180984 3215158672 3086835568 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=499172 CPUtime=877.22
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 40844 0 0 0 86565 1157 0 0 25 0 5 0 945534537 511152128 119564 4294967295 134512640 135180984 3215158672 3086770032 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2654.77
Current children cumulated vsize (KiB) 499172

[startup+942.312 s]
/proc/loadavg: 3.00 3.01 3.00 4/103 28424
/proc/meminfo: memFree=2600168/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=529560 CPUtime=2834.66
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 131523 0 0 0 277603 5863 0 0 18 0 5 0 945534537 542269440 127333 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 132390 127333 68 164 0 132225 0
[pid=25406/tid=25407] ppid=25404 vsize=529560 CPUtime=38.03
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 10502 0 0 0 934 2869 0 0 16 0 5 0 945534537 542269440 127333 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=529560 CPUtime=933.17
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 36978 0 0 0 92385 932 0 0 25 0 5 0 945534537 542269440 127333 4294967295 134512640 135180984 3215158672 3086901104 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=529560 CPUtime=926.25
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 40519 0 0 0 91740 885 0 0 25 0 5 0 945534537 542269440 127333 4294967295 134512640 135180984 3215158672 3086835400 134675767 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=529560 CPUtime=937.22
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 43413 0 0 0 92545 1177 0 0 25 0 5 0 945534537 542269440 127333 4294967295 134512640 135180984 3215158672 3086770032 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2834.66
Current children cumulated vsize (KiB) 529560



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 3.00 3.00 3.00 4/103 28612
/proc/meminfo: memFree=2569996/3368532 swapFree=1959840/1959888
[pid=25406] ppid=25404 vsize=559032 CPUtime=3007.66
/proc/25406/stat : 25406 (satake) S 25404 25406 30957 0 -1 4202496 138907 0 0 0 294836 5930 0 0 18 0 5 0 945534537 572448768 134717 4294967295 134512640 135180984 3215158672 3215158108 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/25406/statm: 139758 134717 68 164 0 139593 0
[pid=25406/tid=25407] ppid=25404 vsize=559032 CPUtime=38.4
/proc/25406/task/25407/stat : 25407 (satake) S 25404 25406 30957 0 -1 4202560 10692 0 0 0 943 2897 0 0 16 0 5 0 945534537 572448768 134717 4294967295 134512640 135180984 3215158672 3086966800 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=25406/tid=25408] ppid=25404 vsize=559032 CPUtime=990.6
/proc/25406/task/25408/stat : 25408 (satake) R 25404 25406 30957 0 -1 4202560 39414 0 0 0 98112 948 0 0 25 0 5 0 945534537 572448768 134717 4294967295 134512640 135180984 3215158672 3086900936 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25406/tid=25409] ppid=25404 vsize=559032 CPUtime=983.76
/proc/25406/task/25409/stat : 25409 (satake) R 25404 25406 30957 0 -1 4202560 42882 0 0 0 97479 897 0 0 25 0 5 0 945534537 572448768 134717 4294967295 134512640 135180984 3215158672 3086835564 134520661 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25406/tid=25410] ppid=25404 vsize=559032 CPUtime=994.9
/proc/25406/task/25410/stat : 25410 (satake) R 25404 25406 30957 0 -1 4202560 45808 0 0 0 98302 1188 0 0 25 0 5 0 945534537 572448768 134717 4294967295 134512640 135180984 3215158672 3086770032 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3007.66
Current children cumulated vsize (KiB) 559032

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.06
CPU time (s): 3007.72
CPU user time (s): 2948.39
CPU system time (s): 59.33
CPU usage (%): 300.755
Max. virtual memory (cumulated for all children) (KiB): 559032

deleting IPC queue 6291456
deleting IPC queue 6324225
deleting IPC queue 6356994
deleting IPC queue 6389763
deleting IPC queue 6422532
deleting IPC queue 6455301
deleting IPC queue 6488070
deleting IPC queue 6520839
deleting IPC queue 6553608
deleting IPC queue 6586377
deleting IPC queue 6619146
deleting IPC queue 6651915
deleting IPC queue 6684684
deleting IPC queue 6717453
deleting IPC queue 6750222
deleting IPC queue 6782991

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2948.39
system time used= 59.33
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 138908
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3824170
involuntary context switches= 2562843

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi39 at 2009-05-30 01:26:18
IDJOB=1777000
IDBENCH=69651
IDSOLVER=629
FILE ID=tipi39/1777000-1243639578
PBS_JOBID=
Free space on /tmp= 5739 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT_RACE08/cnf/mizh-md5-48-5.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1777000-1243639578/watcher-1777000-1243639578 -o /tmp/evaluation-result-1777000-1243639578/solver-1777000-1243639578 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1777000-1243639578.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 8ab50418497c0326ed1ff5d73a4e24a3
RANDOM SEED= 735945341

Linux tipi39 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3109060 kB
Buffers:         57148 kB
Cached:          99012 kB
SwapCached:          0 kB
Active:          95628 kB
Inactive:        76592 kB
HighTotal:     2489216 kB
HighFree:      2376792 kB
LowTotal:       879316 kB
LowFree:        732268 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            6400 kB
Writeback:           0 kB
AnonPages:       16076 kB
Mapped:           5968 kB
Slab:            77344 kB
SReclaimable:    67132 kB
SUnreclaim:      10212 kB
PageTables:        500 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:    94800 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 5739 MiB
End job on tipi39 at 2009-05-30 01:43:00