Trace number 1778995

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 3007.2 1000.08

General information on the benchmark

NameAPPLICATIONS/bitverif/
smulo/smulo128.cnf
MD5SUMc5685247c8f21e8da88f42049fffdb13
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables188473
Number of clauses564650
Sum of the clauses size1317514
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2376432
Number of clauses of size 3188216
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1778995-1243641565/watcher-1778995-1243641565 -o /tmp/evaluation-result-1778995-1243641565/solver-1778995-1243641565 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1778995-1243641565.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 3.21 3.07 3.01 3/115 11626
/proc/meminfo: memFree=2991748/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=4244 CPUtime=0.01
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 799 0 0 0 0 1 0 0 18 0 5 0 1128836352 4345856 755 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 1061 759 63 164 0 896 0
[pid=11626/tid=11627] ppid=11624 vsize=6292 CPUtime=0
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128836352 6443008 805 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=6292 CPUtime=0.01
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 175 0 0 0 0 1 0 0 19 0 5 0 1128836352 6443008 810 4294967295 134512640 135180984 3215523296 3086115108 134583077 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=6292 CPUtime=0
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 566 0 0 0 0 0 0 0 19 0 5 0 1128836352 6443008 815 4294967295 134512640 135180984 3215523296 3086049572 134583077 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=6292 CPUtime=0
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1128836352 6443008 820 4294967295 134512640 135180984 3215523296 3085984580 134705812 0 0 0 0 0 0 0 -1 0 0 0 0

[startup+0.042676 s]
/proc/loadavg: 3.21 3.07 3.01 3/115 11626
/proc/meminfo: memFree=2991748/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=36904 CPUtime=0.09
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 8624 0 0 0 5 4 0 0 18 0 5 0 1128836352 37789696 8577 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 9271 8589 63 164 0 9106 0
[pid=11626/tid=11627] ppid=11624 vsize=37084 CPUtime=0
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128836352 37974016 8595 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=37084 CPUtime=0.04
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 2923 0 0 0 2 2 0 0 19 0 5 0 1128836352 37974016 8600 4294967295 134512640 135180984 3215523296 3086114996 134579745 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=37340 CPUtime=0.04
/proc/11626/task/11629/stat : 11629 (satake) S 11624 11626 11369 0 -1 4202560 3053 0 0 0 3 1 0 0 19 0 5 0 1128836352 38236160 8606 4294967295 134512640 135180984 3215523296 3086049428 134579486 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=37340 CPUtime=0.01
/proc/11626/task/11630/stat : 11630 (satake) S 11624 11626 11369 0 -1 4202560 2553 0 0 0 0 1 0 0 20 0 5 0 1128836352 38236160 8613 4294967295 134512640 135180984 3215523296 3085983892 134579486 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 36904

[startup+0.11418 s]
/proc/loadavg: 3.21 3.07 3.01 3/115 11626
/proc/meminfo: memFree=2991748/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=54840 CPUtime=0.29
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 12140 0 0 0 24 5 0 0 18 0 5 0 1128836352 56156160 12086 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 13807 12094 63 164 0 13642 0
[pid=11626/tid=11627] ppid=11624 vsize=55228 CPUtime=0
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128836352 56553472 12098 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=55228 CPUtime=0.11
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 4105 0 0 0 9 2 0 0 19 0 5 0 1128836352 56553472 12105 4294967295 134512640 135180984 3215523296 3086114944 134691935 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=55228 CPUtime=0.1
/proc/11626/task/11629/stat : 11629 (satake) S 11624 11626 11369 0 -1 4202560 4221 0 0 0 8 2 0 0 19 0 5 0 1128836352 56553472 12111 4294967295 134512640 135180984 3215523296 3086049428 134579486 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=55228 CPUtime=0.08
/proc/11626/task/11630/stat : 11630 (satake) S 11624 11626 11369 0 -1 4202560 3715 0 0 0 7 1 0 0 20 0 5 0 1128836352 56553472 12117 4294967295 134512640 135180984 3215523296 3085983892 134579486 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 54840

[startup+0.311843 s]
/proc/loadavg: 3.21 3.07 3.01 3/115 11626
/proc/meminfo: memFree=2991748/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=98324 CPUtime=0.89
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 22194 0 0 0 78 11 0 0 18 0 5 0 1128836352 100683776 22140 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 24581 22140 63 164 0 24416 0
[pid=11626/tid=11627] ppid=11624 vsize=98324 CPUtime=0
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128836352 100683776 22140 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=98324 CPUtime=0.31
/proc/11626/task/11628/stat : 11628 (satake) D 11624 11626 11369 0 -1 4202560 7440 0 0 0 26 5 0 0 18 0 5 0 1128836352 100683776 22140 4294967295 134512640 135180984 3215523296 3086114896 134702260 0 0 0 0 3223098951 0 0 -1 2 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=98324 CPUtime=0.3
/proc/11626/task/11629/stat : 11629 (satake) D 11624 11626 11369 0 -1 4202560 7572 0 0 0 26 4 0 0 18 0 5 0 1128836352 100683776 22140 4294967295 134512640 135180984 3215523296 3086049360 134702260 0 0 0 0 3223098951 0 0 -1 0 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=98324 CPUtime=0.28
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 7064 0 0 0 26 2 0 0 19 0 5 0 1128836352 100683776 22140 4294967295 134512640 135180984 3215523296 3085983772 134869198 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.89
Current children cumulated vsize (KiB) 98324

[startup+0.711619 s]
/proc/loadavg: 3.21 3.07 3.01 3/115 11626
/proc/meminfo: memFree=2991748/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=142036 CPUtime=2.1
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 38075 0 0 0 194 16 0 0 18 0 5 0 1128836352 145444864 30593 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 35509 30593 66 164 0 35344 0
[pid=11626/tid=11627] ppid=11624 vsize=142036 CPUtime=0.05
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 3321 0 0 0 3 2 0 0 16 0 5 0 1128836352 145444864 30593 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=142036 CPUtime=0.7
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 11629 0 0 0 65 5 0 0 18 0 5 0 1128836352 145444864 30593 4294967295 134512640 135180984 3215523296 3086114688 134532624 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=142036 CPUtime=0.67
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 11534 0 0 0 61 6 0 0 18 0 5 0 1128836352 145444864 30593 4294967295 134512640 135180984 3215523296 3086049188 134532598 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=142036 CPUtime=0.68
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 11480 0 0 0 65 3 0 0 18 0 5 0 1128836352 145444864 30593 4294967295 134512640 135180984 3215523296 3085983592 134520863 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.1
Current children cumulated vsize (KiB) 142036

[startup+1.51158 s]
/proc/loadavg: 3.21 3.07 3.01 5/120 11631
/proc/meminfo: memFree=2870212/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=143272 CPUtime=4.49
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 38365 0 0 0 433 16 0 0 18 0 5 0 1128836352 146710528 30883 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 35818 30883 68 164 0 35653 0
[pid=11626/tid=11627] ppid=11624 vsize=143272 CPUtime=0.06
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 3324 0 0 0 4 2 0 0 15 0 5 0 1128836352 146710528 30883 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=143272 CPUtime=1.5
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 11863 0 0 0 145 5 0 0 18 0 5 0 1128836352 146710528 30883 4294967295 134512640 135180984 3215523296 3086114672 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=143272 CPUtime=1.47
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 11543 0 0 0 141 6 0 0 19 0 5 0 1128836352 146710528 30883 4294967295 134512640 135180984 3215523296 3086048968 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=143272 CPUtime=1.46
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 11524 0 0 0 143 3 0 0 19 0 5 0 1128836352 146710528 30883 4294967295 134512640 135180984 3215523296 3085983404 134706407 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.49
Current children cumulated vsize (KiB) 143272

[startup+3.11152 s]
/proc/loadavg: 3.27 3.08 3.02 4/120 11631
/proc/meminfo: memFree=2869196/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=145576 CPUtime=9.29
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 38562 0 0 0 912 17 0 0 18 0 5 0 1128836352 149069824 31080 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 36394 31080 68 164 0 36229 0
[pid=11626/tid=11627] ppid=11624 vsize=145576 CPUtime=0.06
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 3325 0 0 0 4 2 0 0 16 0 5 0 1128836352 149069824 31080 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=145576 CPUtime=3.1
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 11996 0 0 0 305 5 0 0 22 0 5 0 1128836352 149069824 31080 4294967295 134512640 135180984 3215523296 3086114504 134675767 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=145576 CPUtime=3.07
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 11574 0 0 0 300 7 0 0 22 0 5 0 1128836352 149069824 31080 4294967295 134512640 135180984 3215523296 3086049036 134519095 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=145576 CPUtime=3.06
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 11556 0 0 0 303 3 0 0 23 0 5 0 1128836352 149069824 31080 4294967295 134512640 135180984 3215523296 3085983504 134525230 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.29
Current children cumulated vsize (KiB) 145576

[startup+6.31139 s]
/proc/loadavg: 3.27 3.08 3.02 4/120 11631
/proc/meminfo: memFree=2868200/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=145412 CPUtime=18.85
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 38656 0 0 0 1865 20 0 0 18 0 5 0 1128836352 148901888 31152 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 36353 31152 68 164 0 36188 0
[pid=11626/tid=11627] ppid=11624 vsize=145412 CPUtime=0.08
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 3326 0 0 0 4 4 0 0 15 0 5 0 1128836352 148901888 31152 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=145412 CPUtime=6.29
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 12087 0 0 0 624 5 0 0 25 0 5 0 1128836352 148901888 31152 4294967295 134512640 135180984 3215523296 3086114608 134523800 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=145412 CPUtime=6.23
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 11576 0 0 0 615 8 0 0 25 0 5 0 1128836352 148901888 31152 4294967295 134512640 135180984 3215523296 3086049008 134522614 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=145412 CPUtime=6.25
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 11556 0 0 0 622 3 0 0 25 0 5 0 1128836352 148901888 31152 4294967295 134512640 135180984 3215523296 3085983496 134520909 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 18.85
Current children cumulated vsize (KiB) 145412

[startup+12.7011 s]
/proc/loadavg: 3.23 3.08 3.02 4/120 11632
/proc/meminfo: memFree=2864292/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=150776 CPUtime=37.93
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 39772 0 0 0 3750 43 0 0 18 0 5 0 1128836352 154394624 32268 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 37694 32268 68 164 0 37529 0
[pid=11626/tid=11627] ppid=11624 vsize=150776 CPUtime=0.23
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 3390 0 0 0 9 14 0 0 16 0 5 0 1128836352 154394624 32268 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=150776 CPUtime=12.53
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 12606 0 0 0 1243 10 0 0 25 0 5 0 1128836352 154394624 32268 4294967295 134512640 135180984 3215523296 3086114672 134519339 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=150776 CPUtime=12.54
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 11978 0 0 0 1242 12 0 0 25 0 5 0 1128836352 154394624 32268 4294967295 134512640 135180984 3215523296 3086048968 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=150776 CPUtime=12.63
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 11687 0 0 0 1256 7 0 0 25 0 5 0 1128836352 154394624 32268 4294967295 134512640 135180984 3215523296 3085983500 134519095 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37.93
Current children cumulated vsize (KiB) 150776

[startup+25.5106 s]
/proc/loadavg: 3.19 3.07 3.02 4/120 11632
/proc/meminfo: memFree=2847620/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=167932 CPUtime=76.89
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 43938 0 0 0 7526 163 0 0 18 0 5 0 1128836352 171962368 36434 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 41983 36434 68 164 0 41818 0
[pid=11626/tid=11627] ppid=11624 vsize=167932 CPUtime=1.04
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 3602 0 0 0 31 73 0 0 16 0 5 0 1128836352 171962368 36434 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=167932 CPUtime=25.18
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 14029 0 0 0 2480 38 0 0 25 0 5 0 1128836352 171962368 36434 4294967295 134512640 135180984 3215523296 3086114672 134526384 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=167932 CPUtime=25.27
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 13374 0 0 0 2504 23 0 0 25 0 5 0 1128836352 171962368 36434 4294967295 134512640 135180984 3215523296 3086049136 134528529 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=167932 CPUtime=25.4
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 12822 0 0 0 2511 29 0 0 25 0 5 0 1128836352 171962368 36434 4294967295 134512640 135180984 3215523296 3085983600 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 76.89
Current children cumulated vsize (KiB) 167932

[startup+51.1096 s]
/proc/loadavg: 3.13 3.07 3.01 4/120 11819
/proc/meminfo: memFree=2811372/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=205040 CPUtime=154.63
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 53029 0 0 0 15099 364 0 0 18 0 5 0 1128836352 209960960 45525 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 51260 45525 68 164 0 51095 0
[pid=11626/tid=11627] ppid=11624 vsize=205040 CPUtime=2.28
/proc/11626/task/11627/stat : 11627 (satake) R 11624 11626 11369 0 -1 4202560 3970 0 0 0 60 168 0 0 16 0 5 0 1128836352 209960960 45525 4294967295 134512640 135180984 3215523296 3086180372 134580588 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=205040 CPUtime=50.73
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 17789 0 0 0 4986 87 0 0 25 0 5 0 1128836352 209960960 45525 4294967295 134512640 135180984 3215523296 3086114464 134580407 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=205040 CPUtime=50.8
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 16262 0 0 0 5030 50 0 0 25 0 5 0 1128836352 209960960 45525 4294967295 134512640 135180984 3215523296 3086048968 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=205040 CPUtime=50.82
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 14897 0 0 0 5023 59 0 0 25 0 5 0 1128836352 209960960 45525 4294967295 134512640 135180984 3215523296 3085983600 134528211 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 154.63
Current children cumulated vsize (KiB) 205040

[startup+102.318 s]
/proc/loadavg: 3.09 3.07 3.01 4/120 11821

################
# More data... #
################

[pid=11626/tid=11628] ppid=11624 vsize=645876 CPUtime=519.74
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 48036 0 0 0 51331 643 0 0 25 0 5 0 1128836352 661377024 154979 4294967295 134512640 135180984 3215523296 3086114560 134522920 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=645876 CPUtime=520.87
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 59454 0 0 0 51648 439 0 0 25 0 5 0 1128836352 661377024 154979 4294967295 134512640 135180984 3215523296 3086049040 134525163 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=645876 CPUtime=513.57
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 44810 0 0 0 50870 487 0 0 25 0 5 0 1128836352 661377024 154979 4294967295 134512640 135180984 3215523296 3085983432 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1572.3
Current children cumulated vsize (KiB) 645876

[startup+582.318 s]
/proc/loadavg: 3.00 3.02 3.00 4/120 13331
/proc/meminfo: memFree=2338336/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=680780 CPUtime=1752.42
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 171155 0 0 0 172063 3179 0 0 18 0 5 0 1128836352 697118720 163651 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 170195 163651 68 164 0 170030 0
[pid=11626/tid=11627] ppid=11624 vsize=680780 CPUtime=19.51
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 10695 0 0 0 457 1494 0 0 16 0 5 0 1128836352 697118720 163651 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=680780 CPUtime=579.58
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 51567 0 0 0 57257 701 0 0 25 0 5 0 1128836352 697118720 163651 4294967295 134512640 135180984 3215523296 3086114640 134519935 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=680780 CPUtime=580.78
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 61381 0 0 0 57611 467 0 0 25 0 5 0 1128836352 697118720 163651 4294967295 134512640 135180984 3215523296 3086049040 134525499 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=680780 CPUtime=572.56
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 47401 0 0 0 56739 517 0 0 25 0 5 0 1128836352 697118720 163651 4294967295 134512640 135180984 3215523296 3085983568 134519933 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1752.42
Current children cumulated vsize (KiB) 680780

[startup+642.316 s]
/proc/loadavg: 3.00 3.02 3.00 4/120 13521
/proc/meminfo: memFree=2311604/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=707196 CPUtime=1932.72
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 177864 0 0 0 189871 3401 0 0 18 0 5 0 1128836352 724168704 170360 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 176799 170360 68 164 0 176634 0
[pid=11626/tid=11627] ppid=11624 vsize=707196 CPUtime=20.92
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 11284 0 0 0 495 1597 0 0 16 0 5 0 1128836352 724168704 170360 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=707196 CPUtime=639.4
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 55610 0 0 0 63187 753 0 0 25 0 5 0 1128836352 724168704 170360 4294967295 134512640 135180984 3215523296 3086114672 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=707196 CPUtime=640.03
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 62518 0 0 0 63520 483 0 0 25 0 5 0 1128836352 724168704 170360 4294967295 134512640 135180984 3215523296 3086049152 134532624 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=707196 CPUtime=632.37
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 48341 0 0 0 62669 568 0 0 25 0 5 0 1128836352 724168704 170360 4294967295 134512640 135180984 3215523296 3085983600 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1932.72
Current children cumulated vsize (KiB) 707196

[startup+702.304 s]
/proc/loadavg: 3.00 3.01 3.00 4/120 13709
/proc/meminfo: memFree=2289752/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=729368 CPUtime=2112.69
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 183377 0 0 0 207744 3525 0 0 18 0 5 0 1128836352 746872832 175873 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 182342 175873 68 164 0 182177 0
[pid=11626/tid=11627] ppid=11624 vsize=729368 CPUtime=21.77
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 11568 0 0 0 519 1658 0 0 16 0 5 0 1128836352 746872832 175873 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=729368 CPUtime=699.35
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 57879 0 0 0 69166 769 0 0 25 0 5 0 1128836352 746872832 175873 4294967295 134512640 135180984 3215523296 3086114672 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=729368 CPUtime=700.01
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 63679 0 0 0 69495 506 0 0 25 0 5 0 1128836352 746872832 175873 4294967295 134512640 135180984 3215523296 3086049088 134527255 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=729368 CPUtime=691.57
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 50140 0 0 0 68565 592 0 0 25 0 5 0 1128836352 746872832 175873 4294967295 134512640 135180984 3215523296 3085983596 134519895 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2112.69
Current children cumulated vsize (KiB) 729368

[startup+762.321 s]
/proc/loadavg: 3.04 3.02 3.00 4/120 13898
/proc/meminfo: memFree=2263508/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=754304 CPUtime=2292.58
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 189854 0 0 0 225628 3630 0 0 18 0 5 0 1128836352 772407296 182350 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 188576 182350 68 164 0 188411 0
[pid=11626/tid=11627] ppid=11624 vsize=754304 CPUtime=22.42
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 11851 0 0 0 539 1703 0 0 15 0 5 0 1128836352 772407296 182350 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=754304 CPUtime=759.33
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 59337 0 0 0 75152 781 0 0 25 0 5 0 1128836352 772407296 182350 4294967295 134512640 135180984 3215523296 3086114672 134528214 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=754304 CPUtime=759.97
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 65742 0 0 0 75462 535 0 0 25 0 5 0 1128836352 772407296 182350 4294967295 134512640 135180984 3215523296 3086049068 134523868 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=754304 CPUtime=750.86
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 52813 0 0 0 74475 611 0 0 25 0 5 0 1128836352 772407296 182350 4294967295 134512640 135180984 3215523296 3085983592 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2292.58
Current children cumulated vsize (KiB) 754304

[startup+822.309 s]
/proc/loadavg: 3.01 3.02 3.00 4/120 14086
/proc/meminfo: memFree=2243128/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=774480 CPUtime=2472.39
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 195054 0 0 0 243474 3765 0 0 18 0 5 0 1128836352 793067520 187550 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 193620 187550 68 164 0 193455 0
[pid=11626/tid=11627] ppid=11624 vsize=774480 CPUtime=23.22
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 12235 0 0 0 555 1767 0 0 15 0 5 0 1128836352 793067520 187550 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=774480 CPUtime=819.26
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 60531 0 0 0 81132 794 0 0 25 0 5 0 1128836352 793067520 187550 4294967295 134512640 135180984 3215523296 3086114576 134525183 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=774480 CPUtime=819.93
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 67756 0 0 0 81429 564 0 0 25 0 5 0 1128836352 793067520 187550 4294967295 134512640 135180984 3215523296 3086048968 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=774480 CPUtime=809.98
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 54421 0 0 0 80358 640 0 0 25 0 5 0 1128836352 793067520 187550 4294967295 134512640 135180984 3215523296 3085983600 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2472.39
Current children cumulated vsize (KiB) 774480

[startup+882.306 s]
/proc/loadavg: 3.00 3.01 3.00 4/120 14274
/proc/meminfo: memFree=2218032/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=800336 CPUtime=2652.99
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 201137 0 0 0 261323 3976 0 0 18 0 5 0 1128836352 819544064 193633 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 200084 193633 68 164 0 199919 0
[pid=11626/tid=11627] ppid=11624 vsize=800336 CPUtime=24.53
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 12681 0 0 0 583 1870 0 0 16 0 5 0 1128836352 819544064 193633 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=800336 CPUtime=878.96
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 61740 0 0 0 87078 818 0 0 25 0 5 0 1128836352 819544064 193633 4294967295 134512640 135180984 3215523296 3086114672 134528211 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=800336 CPUtime=879.71
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 70789 0 0 0 87370 601 0 0 25 0 5 0 1128836352 819544064 193633 4294967295 134512640 135180984 3215523296 3086049136 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=800336 CPUtime=869.8
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 55816 0 0 0 86293 687 0 0 25 0 5 0 1128836352 819544064 193633 4294967295 134512640 135180984 3215523296 3085983600 134528211 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2652.99
Current children cumulated vsize (KiB) 800336

[startup+942.314 s]
/proc/loadavg: 3.00 3.00 3.00 5/120 14460
/proc/meminfo: memFree=2194644/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=823912 CPUtime=2833.55
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 207042 0 0 0 279236 4119 0 0 18 0 5 0 1128836352 843685888 199538 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 205978 199538 68 164 0 205813 0
[pid=11626/tid=11627] ppid=11624 vsize=823912 CPUtime=25.36
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 12955 0 0 0 600 1936 0 0 16 0 5 0 1128836352 843685888 199538 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=823912 CPUtime=938.77
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 62179 0 0 0 93046 831 0 0 25 0 5 0 1128836352 843685888 199538 4294967295 134512640 135180984 3215523296 3086114672 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=823912 CPUtime=939.7
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 74745 0 0 0 93333 637 0 0 25 0 5 0 1128836352 843685888 199538 4294967295 134512640 135180984 3215523296 3086048928 134580407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=823912 CPUtime=929.73
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 57052 0 0 0 92258 715 0 0 25 0 5 0 1128836352 843685888 199538 4294967295 134512640 135180984 3215523296 3085983600 134528211 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2833.55
Current children cumulated vsize (KiB) 823912



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 3.08 3.02 3.01 4/120 14652
/proc/meminfo: memFree=2176292/3368532 swapFree=1941392/1959888
[pid=11626] ppid=11624 vsize=841812 CPUtime=3007.12
/proc/11626/stat : 11626 (satake) S 11624 11626 11369 0 -1 4202496 211474 0 0 0 296429 4283 0 0 18 0 5 0 1128836352 862015488 203970 4294967295 134512640 135180984 3215523296 3215522732 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/11626/statm: 210453 203970 68 164 0 210288 0
[pid=11626/tid=11627] ppid=11624 vsize=841812 CPUtime=26.37
/proc/11626/task/11627/stat : 11627 (satake) S 11624 11626 11369 0 -1 4202560 13320 0 0 0 623 2014 0 0 16 0 5 0 1128836352 862015488 203970 4294967295 134512640 135180984 3215523296 3086180368 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=11626/tid=11628] ppid=11624 vsize=841812 CPUtime=996.08
/proc/11626/task/11628/stat : 11628 (satake) R 11624 11626 11369 0 -1 4202560 62700 0 0 0 98758 850 0 0 25 0 5 0 1128836352 862015488 203970 4294967295 134512640 135180984 3215523296 3086114672 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=11626/tid=11629] ppid=11624 vsize=841812 CPUtime=997.29
/proc/11626/task/11629/stat : 11629 (satake) R 11624 11626 11369 0 -1 4202560 77425 0 0 0 99065 664 0 0 25 0 5 0 1128836352 862015488 203970 4294967295 134512640 135180984 3215523296 3086049128 134520907 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=11626/tid=11630] ppid=11624 vsize=841812 CPUtime=987.38
/proc/11626/task/11630/stat : 11630 (satake) R 11624 11626 11369 0 -1 4202560 57918 0 0 0 97983 755 0 0 25 0 5 0 1128836352 862015488 203970 4294967295 134512640 135180984 3215523296 3085983500 134522603 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3007.12
Current children cumulated vsize (KiB) 841812

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.08
CPU time (s): 3007.2
CPU user time (s): 2964.33
CPU system time (s): 42.87
CPU usage (%): 300.696
Max. virtual memory (cumulated for all children) (KiB): 841812

deleting IPC queue 8912896
deleting IPC queue 8945665
deleting IPC queue 8978434
deleting IPC queue 9011203
deleting IPC queue 9043972
deleting IPC queue 9076741
deleting IPC queue 9109510
deleting IPC queue 9142279
deleting IPC queue 9175048
deleting IPC queue 9207817
deleting IPC queue 9240586
deleting IPC queue 9273355
deleting IPC queue 9306124
deleting IPC queue 9338893
deleting IPC queue 9371662
deleting IPC queue 9404431

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2964.33
system time used= 42.87
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 211474
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2691907
involuntary context switches= 1833868

runsolver used 0.01 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 01:59:25
IDJOB=1778995
IDBENCH=70789
IDSOLVER=629
FILE ID=/1778995-1243641565
PBS_JOBID=
Free space on /tmp= 15720 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bitverif/smulo/smulo128.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1778995-1243641565/watcher-1778995-1243641565 -o /tmp/evaluation-result-1778995-1243641565/solver-1778995-1243641565 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1778995-1243641565.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= c5685247c8f21e8da88f42049fffdb13
RANDOM SEED= 938108257

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2991748 kB
Buffers:         48536 kB
Cached:         241772 kB
SwapCached:       4320 kB
Active:         150080 kB
Inactive:       151000 kB
HighTotal:     2489216 kB
HighFree:      2234604 kB
LowTotal:       879316 kB
LowFree:        757144 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:           10884 kB
Writeback:           0 kB
AnonPages:        9356 kB
Mapped:           4516 kB
Slab:            64892 kB
SReclaimable:    55908 kB
SUnreclaim:       8984 kB
PageTables:        748 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127076 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15720 MiB
End job on  at 2009-05-30 02:16:08