Trace number 1780210

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 3004.06 1000.07

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_L150_coli.sat.cnf
MD5SUMba6884aaa746378e56c38fd8b3d0255e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark862.84
Satisfiable
(Un)Satisfiability was proved
Number of variables486992
Number of clauses2456708
Sum of the clauses size7147094
Maximum clause length11
Minimum clause length1
Number of clauses of size 145577
Number of clauses of size 2599727
Number of clauses of size 31431108
Number of clauses of size 4295435
Number of clauses of size 584412
Number of clauses of size over 5449

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780210-1243646434/watcher-1780210-1243646434 -o /tmp/evaluation-result-1780210-1243646434/solver-1780210-1243646434 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1780210-1243646434.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.90 2.98 2.99 3/99 6916
/proc/meminfo: memFree=3093476/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=3216 CPUtime=0
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 652 0 0 0 0 0 0 0 18 0 5 0 1129308094 3293184 609 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 804 609 63 164 0 639 0
[pid=6916/tid=6917] ppid=6914 vsize=5264 CPUtime=0
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129308094 5390336 709 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=5264 CPUtime=0
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 640 0 0 0 0 0 0 0 19 0 5 0 1129308094 5390336 715 4294967295 134512640 135180984 3218184304 3086315812 134583077 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=5264 CPUtime=0
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 5 0 1129308094 5390336 720 4294967295 134512640 135180984 3218184304 3086250820 134705812 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=5264 CPUtime=0
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1129308094 5390336 725 4294967295 134512640 135180984 3218184304 3086185284 134705812 0 0 0 0 0 0 0 -1 2 0 0 0

[startup+0.046861 s]
/proc/loadavg: 2.90 2.98 2.99 3/99 6916
/proc/meminfo: memFree=3093476/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=50404 CPUtime=0.06
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 10668 0 0 0 0 6 0 0 18 0 5 0 1129308094 51613696 10625 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 12601 10625 63 164 0 12436 0
[pid=6916/tid=6917] ppid=6914 vsize=50404 CPUtime=0
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129308094 51613696 10625 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=50404 CPUtime=0.03
/proc/6916/task/6918/stat : 6918 (satake) D 6914 6916 21929 0 -1 4202560 3753 0 0 0 0 3 0 0 19 0 5 0 1129308094 51613696 10625 4294967295 134512640 135180984 3218184304 3086315812 134583077 0 0 0 0 3223098951 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=50404 CPUtime=0.03
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 4102 0 0 0 0 3 0 0 19 0 5 0 1129308094 51613696 10625 4294967295 134512640 135180984 3218184304 3086250292 134706046 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=50404 CPUtime=0
/proc/6916/task/6920/stat : 6920 (satake) D 6914 6916 21929 0 -1 4202560 2695 0 0 0 0 0 0 0 20 0 5 0 1129308094 51613696 10625 4294967295 134512640 135180984 3218184304 3086184740 134583077 0 0 0 0 3223098951 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 50404

[startup+0.113595 s]
/proc/loadavg: 2.90 2.98 2.99 3/99 6916
/proc/meminfo: memFree=3093476/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=181660 CPUtime=0.24
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 34586 0 0 0 0 24 0 0 18 0 5 0 1129308094 186019840 34543 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 45415 34551 63 164 0 45250 0
[pid=6916/tid=6917] ppid=6914 vsize=181660 CPUtime=0
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129308094 186019840 34555 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=181660 CPUtime=0.09
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 12357 0 0 0 0 9 0 0 19 0 5 0 1129308094 186019840 34560 4294967295 134512640 135180984 3218184304 3086315520 134666192 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=181660 CPUtime=0.09
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 11778 0 0 0 0 9 0 0 19 0 5 0 1129308094 186019840 34564 4294967295 134512640 135180984 3218184304 3086250276 134583077 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=181660 CPUtime=0.06
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 10354 0 0 0 0 6 0 0 20 0 5 0 1129308094 186019840 34568 4294967295 134512640 135180984 3218184304 3086184740 134583077 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 181660

[startup+0.306833 s]
/proc/loadavg: 2.90 2.98 2.99 3/99 6916
/proc/meminfo: memFree=3093476/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=250788 CPUtime=0.83
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 59484 0 0 0 45 38 0 0 18 0 5 0 1129308094 256806912 59332 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 62697 59332 63 164 0 62532 0
[pid=6916/tid=6917] ppid=6914 vsize=250788 CPUtime=0
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129308094 256806912 59334 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=250788 CPUtime=0.28
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 19869 0 0 0 14 14 0 0 18 0 5 0 1129308094 256806912 59334 4294967295 134512640 135180984 3218184304 3086315608 134675846 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=250788 CPUtime=0.29
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 19713 0 0 0 18 11 0 0 18 0 5 0 1129308094 256806912 59335 4294967295 134512640 135180984 3218184304 3086250288 134534762 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=250788 CPUtime=0.26
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 19786 0 0 0 13 13 0 0 20 0 5 0 1129308094 256806912 59335 4294967295 134512640 135180984 3218184304 3086184736 134513782 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.83
Current children cumulated vsize (KiB) 250788

[startup+0.706796 s]
/proc/loadavg: 2.90 2.98 2.99 3/99 6916
/proc/meminfo: memFree=3093476/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=359724 CPUtime=2.02
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 76442 0 0 0 160 42 0 0 18 0 5 0 1129308094 368357376 76290 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 89931 76292 63 164 0 89766 0
[pid=6916/tid=6917] ppid=6914 vsize=359724 CPUtime=0
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129308094 368357376 76292 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=359724 CPUtime=0.68
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 25490 0 0 0 54 14 0 0 17 0 5 0 1129308094 368357376 76293 4294967295 134512640 135180984 3218184304 3086315592 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=359724 CPUtime=0.68
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 25328 0 0 0 55 13 0 0 17 0 5 0 1129308094 368357376 76293 4294967295 134512640 135180984 3218184304 3086250224 134522576 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=359724 CPUtime=0.66
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 25509 0 0 0 51 15 0 0 18 0 5 0 1129308094 368357376 76293 4294967295 134512640 135180984 3218184304 3086184736 134513782 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.02
Current children cumulated vsize (KiB) 359724

[startup+1.50672 s]
/proc/loadavg: 2.90 2.98 2.99 5/104 6921
/proc/meminfo: memFree=2738996/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=457380 CPUtime=4.41
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 109625 0 0 0 389 52 0 0 18 0 5 0 1129308094 468357120 109473 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 114345 109473 63 164 0 114180 0
[pid=6916/tid=6917] ppid=6914 vsize=457380 CPUtime=0
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129308094 468357120 109473 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=457380 CPUtime=1.48
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 36563 0 0 0 130 18 0 0 17 0 5 0 1129308094 468357120 109475 4294967295 134512640 135180984 3218184304 3086315608 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=457380 CPUtime=1.47
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 36305 0 0 0 132 15 0 0 16 0 5 0 1129308094 468357120 109475 4294967295 134512640 135180984 3218184304 3086250272 134513782 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=457380 CPUtime=1.46
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 36641 0 0 0 127 19 0 0 17 0 5 0 1129308094 468357120 109475 4294967295 134512640 135180984 3218184304 3086184736 134513754 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4.41
Current children cumulated vsize (KiB) 457380

[startup+3.10656 s]
/proc/loadavg: 2.90 2.98 2.99 4/104 6921
/proc/meminfo: memFree=2582164/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=578824 CPUtime=9.18
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 139000 0 0 0 855 63 0 0 18 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 144706 138848 64 164 0 144541 0
[pid=6916/tid=6917] ppid=6914 vsize=578824 CPUtime=0
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=578824 CPUtime=3.07
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 46291 0 0 0 288 19 0 0 16 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3086315728 134520804 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=578824 CPUtime=3.05
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 45953 0 0 0 287 18 0 0 16 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3086250188 134520865 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=578824 CPUtime=3.06
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 46638 0 0 0 280 26 0 0 18 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3086184652 134520865 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 9.18
Current children cumulated vsize (KiB) 578824

[startup+6.30626 s]
/proc/loadavg: 2.99 3.00 3.00 4/104 6921
/proc/meminfo: memFree=2538764/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=578824 CPUtime=18.78
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 139000 0 0 0 1815 63 0 0 18 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 144706 138848 64 164 0 144541 0
[pid=6916/tid=6917] ppid=6914 vsize=578824 CPUtime=0
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=578824 CPUtime=6.27
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 46291 0 0 0 608 19 0 0 21 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3086315728 134520773 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=578824 CPUtime=6.25
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 45953 0 0 0 607 18 0 0 21 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3086250192 134520821 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=578824 CPUtime=6.26
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 46638 0 0 0 600 26 0 0 25 0 5 0 1129308094 592715776 138848 4294967295 134512640 135180984 3218184304 3086184656 134520800 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 18.78
Current children cumulated vsize (KiB) 578824

[startup+12.7056 s]
/proc/loadavg: 2.99 3.00 3.00 4/104 6921
/proc/meminfo: memFree=2654612/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=462988 CPUtime=38.1
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 147106 0 0 0 3702 108 0 0 18 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 115747 109949 68 164 0 115582 0
[pid=6916/tid=6917] ppid=6914 vsize=462988 CPUtime=0.45
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 6167 0 0 0 23 22 0 0 16 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=462988 CPUtime=12.65
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 46974 0 0 0 1236 29 0 0 25 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3086315304 134520873 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=462988 CPUtime=12.52
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 46627 0 0 0 1231 21 0 0 25 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3086249776 134520798 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=462988 CPUtime=12.48
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 47227 0 0 0 1212 36 0 0 25 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3086184236 134520865 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38.1
Current children cumulated vsize (KiB) 462988

[startup+25.5144 s]
/proc/loadavg: 2.99 3.00 3.00 4/104 6921
/proc/meminfo: memFree=2654964/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=462988 CPUtime=76.53
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 147106 0 0 0 7545 108 0 0 18 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 115747 109949 68 164 0 115582 0
[pid=6916/tid=6917] ppid=6914 vsize=462988 CPUtime=0.45
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 6167 0 0 0 23 22 0 0 16 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=462988 CPUtime=25.46
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 46974 0 0 0 2517 29 0 0 25 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3086315312 134520798 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=462988 CPUtime=25.33
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 46627 0 0 0 2512 21 0 0 25 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3086249776 134520798 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=462988 CPUtime=25.29
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 47227 0 0 0 2493 36 0 0 25 0 5 0 1129308094 474099712 109949 4294967295 134512640 135180984 3218184304 3086184240 134520773 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 76.53
Current children cumulated vsize (KiB) 462988

[startup+51.112 s]
/proc/loadavg: 2.99 3.00 3.00 4/104 7106
/proc/meminfo: memFree=2650388/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=463844 CPUtime=154
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 147781 0 0 0 15104 296 0 0 18 0 5 0 1129308094 474976256 110624 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 115961 110624 68 164 0 115796 0
[pid=6916/tid=6917] ppid=6914 vsize=463844 CPUtime=1.66
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 6256 0 0 0 50 116 0 0 16 0 5 0 1129308094 474976256 110624 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=463844 CPUtime=50.81
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 47171 0 0 0 5020 61 0 0 25 0 5 0 1129308094 474976256 110624 4294967295 134512640 135180984 3218184304 3086315376 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=463844 CPUtime=50.75
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 46903 0 0 0 5026 49 0 0 25 0 5 0 1129308094 474976256 110624 4294967295 134512640 135180984 3218184304 3086249840 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=463844 CPUtime=50.78
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 47340 0 0 0 5008 70 0 0 25 0 5 0 1129308094 474976256 110624 4294967295 134512640 135180984 3218184304 3086184240 134523821 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 154
Current children cumulated vsize (KiB) 463844

[startup+102.307 s]
/proc/loadavg: 3.06 3.01 3.00 4/104 7114

################
# More data... #
################

[pid=6916/tid=6918] ppid=6914 vsize=607732 CPUtime=518.24
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 57793 0 0 0 51400 424 0 0 25 0 5 0 1129308094 622317568 145466 4294967295 134512640 135180984 3218184304 3086315376 134528211 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=607732 CPUtime=516.59
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 56974 0 0 0 51147 512 0 0 25 0 5 0 1129308094 622317568 145466 4294967295 134512640 135180984 3218184304 3086249836 134520854 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=607732 CPUtime=519.28
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 56904 0 0 0 51355 573 0 0 25 0 5 0 1129308094 622317568 145466 4294967295 134512640 135180984 3218184304 3086184228 134521144 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1572.34
Current children cumulated vsize (KiB) 607732

[startup+582.311 s]
/proc/loadavg: 3.11 3.04 3.01 4/104 8623
/proc/meminfo: memFree=2501444/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=621032 CPUtime=1752.2
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 185552 0 0 0 172176 3044 0 0 18 0 5 0 1129308094 635936768 148395 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 155258 148395 68 164 0 155093 0
[pid=6916/tid=6917] ppid=6914 vsize=621032 CPUtime=18.93
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 11161 0 0 0 429 1464 0 0 16 0 5 0 1129308094 635936768 148395 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=621032 CPUtime=578.15
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 58678 0 0 0 57374 441 0 0 25 0 5 0 1129308094 635936768 148395 4294967295 134512640 135180984 3218184304 3086315392 134532624 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=621032 CPUtime=576.58
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 57910 0 0 0 57112 546 0 0 25 0 5 0 1129308094 635936768 148395 4294967295 134512640 135180984 3218184304 3086249840 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=621032 CPUtime=578.54
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 57692 0 0 0 57261 593 0 0 25 0 5 0 1129308094 635936768 148395 4294967295 134512640 135180984 3218184304 3086184296 134518252 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1752.2
Current children cumulated vsize (KiB) 621032

[startup+642.306 s]
/proc/loadavg: 3.11 3.05 3.00 4/104 8811
/proc/meminfo: memFree=2489424/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=631928 CPUtime=1932.02
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 188375 0 0 0 190011 3191 0 0 18 0 5 0 1129308094 647094272 151218 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 157982 151218 68 164 0 157817 0
[pid=6916/tid=6917] ppid=6914 vsize=631928 CPUtime=19.84
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 11487 0 0 0 455 1529 0 0 16 0 5 0 1129308094 647094272 151218 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=631928 CPUtime=638.09
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 59530 0 0 0 63346 463 0 0 25 0 5 0 1129308094 647094272 151218 4294967295 134512640 135180984 3218184304 3086315376 134528211 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=631928 CPUtime=636.49
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 58775 0 0 0 63059 590 0 0 25 0 5 0 1129308094 647094272 151218 4294967295 134512640 135180984 3218184304 3086249840 134528524 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=631928 CPUtime=637.6
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 58472 0 0 0 63151 609 0 0 25 0 5 0 1129308094 647094272 151218 4294967295 134512640 135180984 3218184304 3086184304 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1932.02
Current children cumulated vsize (KiB) 631928

[startup+702.32 s]
/proc/loadavg: 3.11 3.05 3.00 4/104 8998
/proc/meminfo: memFree=2478760/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=641772 CPUtime=2111.82
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 191102 0 0 0 207852 3330 0 0 18 0 5 0 1129308094 657174528 153945 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 160443 153945 68 164 0 160278 0
[pid=6916/tid=6917] ppid=6914 vsize=641772 CPUtime=20.79
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 11835 0 0 0 480 1599 0 0 16 0 5 0 1129308094 657174528 153945 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=641772 CPUtime=697.92
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 60268 0 0 0 69305 487 0 0 25 0 5 0 1129308094 657174528 153945 4294967295 134512640 135180984 3218184304 3086315376 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=641772 CPUtime=696.47
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 59630 0 0 0 69023 624 0 0 25 0 5 0 1129308094 657174528 153945 4294967295 134512640 135180984 3218184304 3086249832 134520860 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=641772 CPUtime=696.64
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 59258 0 0 0 69044 620 0 0 25 0 5 0 1129308094 657174528 153945 4294967295 134512640 135180984 3218184304 3086184304 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2111.82
Current children cumulated vsize (KiB) 641772

[startup+762.314 s]
/proc/loadavg: 3.10 3.06 3.00 4/104 9191
/proc/meminfo: memFree=2468468/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=652592 CPUtime=2291.55
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 193588 0 0 0 225680 3475 0 0 18 0 5 0 1129308094 668254208 156431 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 163148 156431 68 164 0 162983 0
[pid=6916/tid=6917] ppid=6914 vsize=652592 CPUtime=21.78
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 12166 0 0 0 504 1674 0 0 16 0 5 0 1129308094 668254208 156431 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=652592 CPUtime=757.72
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 60891 0 0 0 75264 508 0 0 25 0 5 0 1129308094 668254208 156431 4294967295 134512640 135180984 3218184304 3086315376 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=652592 CPUtime=756.42
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 60448 0 0 0 74985 657 0 0 25 0 5 0 1129308094 668254208 156431 4294967295 134512640 135180984 3218184304 3086249840 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=652592 CPUtime=755.63
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 59972 0 0 0 74927 636 0 0 25 0 5 0 1129308094 668254208 156431 4294967295 134512640 135180984 3218184304 3086184304 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2291.55
Current children cumulated vsize (KiB) 652592

[startup+822.309 s]
/proc/loadavg: 3.09 3.06 3.00 5/104 9379
/proc/meminfo: memFree=2458920/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=662072 CPUtime=2471.37
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 195872 0 0 0 243516 3621 0 0 18 0 5 0 1129308094 677961728 158715 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 165518 158715 68 164 0 165353 0
[pid=6916/tid=6917] ppid=6914 vsize=662072 CPUtime=22.76
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 12487 0 0 0 531 1745 0 0 15 0 5 0 1129308094 677961728 158715 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=662072 CPUtime=817.65
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 61428 0 0 0 81232 533 0 0 25 0 5 0 1129308094 677961728 158715 4294967295 134512640 135180984 3218184304 3086315312 134523667 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=662072 CPUtime=816.35
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 61223 0 0 0 80941 694 0 0 25 0 5 0 1129308094 677961728 158715 4294967295 134512640 135180984 3218184304 3086249840 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=662072 CPUtime=814.61
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 60623 0 0 0 80812 649 0 0 25 0 5 0 1129308094 677961728 158715 4294967295 134512640 135180984 3218184304 3086184368 134532460 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2471.37
Current children cumulated vsize (KiB) 662072

[startup+882.313 s]
/proc/loadavg: 3.08 3.06 3.00 4/104 9566
/proc/meminfo: memFree=2450356/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=670772 CPUtime=2651.26
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 197976 0 0 0 261426 3700 0 0 18 0 5 0 1129308094 686870528 160819 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 167693 160819 68 164 0 167528 0
[pid=6916/tid=6917] ppid=6914 vsize=670772 CPUtime=23.26
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 12681 0 0 0 547 1779 0 0 16 0 5 0 1129308094 686870528 160819 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=670772 CPUtime=877.57
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 62006 0 0 0 87215 542 0 0 25 0 5 0 1129308094 686870528 160819 4294967295 134512640 135180984 3218184304 3086315376 134528536 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=670772 CPUtime=876.33
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 61927 0 0 0 86913 720 0 0 25 0 5 0 1129308094 686870528 160819 4294967295 134512640 135180984 3218184304 3086249840 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=670772 CPUtime=874.1
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 61251 0 0 0 86751 659 0 0 25 0 5 0 1129308094 686870528 160819 4294967295 134512640 135180984 3218184304 3086184304 134528680 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2651.26
Current children cumulated vsize (KiB) 670772

[startup+942.307 s]
/proc/loadavg: 3.10 3.06 3.00 4/104 9754
/proc/meminfo: memFree=2442924/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=678804 CPUtime=2831.06
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 200010 0 0 0 279271 3835 0 0 18 0 5 0 1129308094 695095296 162853 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 169701 162853 68 164 0 169536 0
[pid=6916/tid=6917] ppid=6914 vsize=678804 CPUtime=24.1
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 12993 0 0 0 563 1847 0 0 15 0 5 0 1129308094 695095296 162853 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=678804 CPUtime=937.43
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 62558 0 0 0 93186 557 0 0 25 0 5 0 1129308094 695095296 162853 4294967295 134512640 135180984 3218184304 3086315344 134519935 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=678804 CPUtime=936.3
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 62508 0 0 0 92874 756 0 0 25 0 5 0 1129308094 695095296 162853 4294967295 134512640 135180984 3218184304 3086249904 134532467 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=678804 CPUtime=933.23
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 61840 0 0 0 92648 675 0 0 25 0 5 0 1129308094 695095296 162853 4294967295 134512640 135180984 3218184304 3086184320 134532610 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2831.06
Current children cumulated vsize (KiB) 678804



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 3.03 3.05 3.00 4/104 9941
/proc/meminfo: memFree=2434864/3368532 swapFree=1953580/1959888
[pid=6916] ppid=6914 vsize=686100 CPUtime=3003.96
/proc/6916/stat : 6916 (satake) S 6914 6916 21929 0 -1 4202496 201865 0 0 0 296448 3948 0 0 18 0 5 0 1129308094 702566400 164708 4294967295 134512640 135180984 3218184304 3218183740 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/6916/statm: 171525 164708 68 164 0 171360 0
[pid=6916/tid=6917] ppid=6914 vsize=686100 CPUtime=24.86
/proc/6916/task/6917/stat : 6917 (satake) S 6914 6916 21929 0 -1 4202560 13281 0 0 0 585 1901 0 0 15 0 5 0 1129308094 702566400 164708 4294967295 134512640 135180984 3218184304 3086381072 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=6916/tid=6918] ppid=6914 vsize=686100 CPUtime=995.03
/proc/6916/task/6918/stat : 6918 (satake) R 6914 6916 21929 0 -1 4202560 63065 0 0 0 98931 572 0 0 25 0 5 0 1129308094 702566400 164708 4294967295 134512640 135180984 3218184304 3086315440 134532508 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=6916/tid=6919] ppid=6914 vsize=686100 CPUtime=993.93
/proc/6916/task/6919/stat : 6919 (satake) R 6914 6916 21929 0 -1 4202560 63019 0 0 0 98603 790 0 0 25 0 5 0 1129308094 702566400 164708 4294967295 134512640 135180984 3218184304 3086249840 134528685 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=6916/tid=6920] ppid=6914 vsize=686100 CPUtime=990.14
/proc/6916/task/6920/stat : 6920 (satake) R 6914 6916 21929 0 -1 4202560 62389 0 0 0 98329 685 0 0 25 0 5 0 1129308094 702566400 164708 4294967295 134512640 135180984 3218184304 3086184304 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3003.96
Current children cumulated vsize (KiB) 686100

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.07
CPU time (s): 3004.06
CPU user time (s): 2964.54
CPU system time (s): 39.52
CPU usage (%): 300.384
Max. virtual memory (cumulated for all children) (KiB): 686100

deleting IPC queue 11010048
deleting IPC queue 11042817
deleting IPC queue 11075586
deleting IPC queue 11108355
deleting IPC queue 11141124
deleting IPC queue 11173893
deleting IPC queue 11206662
deleting IPC queue 11239431
deleting IPC queue 11272200
deleting IPC queue 11304969
deleting IPC queue 11337738
deleting IPC queue 11370507
deleting IPC queue 11403276
deleting IPC queue 11436045
deleting IPC queue 11468814
deleting IPC queue 11501583

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2964.54
system time used= 39.52
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 201867
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2205276
involuntary context switches= 1566366

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 03:20:34
IDJOB=1780210
IDBENCH=70961
IDSOLVER=629
FILE ID=/1780210-1243646434
PBS_JOBID=
Free space on /tmp= 15837 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_L150_coli.sat.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780210-1243646434/watcher-1780210-1243646434 -o /tmp/evaluation-result-1780210-1243646434/solver-1780210-1243646434 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1780210-1243646434.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= ba6884aaa746378e56c38fd8b3d0255e
RANDOM SEED= 1540499988

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3093476 kB
Buffers:         38260 kB
Cached:         158548 kB
SwapCached:       2424 kB
Active:         142268 kB
Inactive:        64948 kB
HighTotal:     2489216 kB
HighFree:      2317988 kB
LowTotal:       879316 kB
LowFree:        775488 kB
SwapTotal:     1959888 kB
SwapFree:      1953580 kB
Dirty:           50912 kB
Writeback:           0 kB
AnonPages:        9728 kB
Mapped:           4940 kB
Slab:            58100 kB
SReclaimable:    49440 kB
SUnreclaim:       8660 kB
PageTables:        536 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:    93568 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15837 MiB
End job on  at 2009-05-30 03:37:19