Trace number 1781290

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 3016.97 1000.07

General information on the benchmark

Namemanol-pipe-c7nidw.cnf
MD5SUMcddc29f8f256e39e02d9b418f68e802c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark146.21
Satisfiable
(Un)Satisfiability was proved
Number of variables169072
Number of clauses501421
Sum of the clauses size1169981
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2334280
Number of clauses of size 3167140
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781290-1243653738/watcher-1781290-1243653738 -o /tmp/evaluation-result-1781290-1243653738/solver-1781290-1243653738 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1781290-1243653738.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.75 2.91 2.95 3/115 19103
/proc/meminfo: memFree=2923320/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=5264 CPUtime=0
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 840 0 0 0 0 0 0 0 18 0 5 0 1130053681 5390336 797 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 1316 801 63 164 0 1151 0
[pid=19103/tid=19104] ppid=19101 vsize=5264 CPUtime=0
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130053681 5390336 820 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=5264 CPUtime=0
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 750 0 0 0 0 0 0 0 19 0 5 0 1130053681 5390336 825 4294967295 134512640 135180984 3219444128 3086709028 134583077 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=5264 CPUtime=0
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 5 0 1130053681 5390336 831 4294967295 134512640 135180984 3219444128 3086644036 134705812 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=5264 CPUtime=0
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1130053681 5390336 835 4294967295 134512640 135180984 3219444128 3086578500 134705812 0 0 0 0 0 0 0 -1 2 0 0 0

[startup+0.036871 s]
/proc/loadavg: 2.75 2.91 2.95 3/115 19103
/proc/meminfo: memFree=2923320/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=28388 CPUtime=0.04
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 6202 0 0 0 2 2 0 0 18 0 5 0 1130053681 29069312 6159 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 7097 6160 63 164 0 6932 0
[pid=19103/tid=19104] ppid=19101 vsize=28388 CPUtime=0
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130053681 29069312 6160 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=28388 CPUtime=0.02
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 2237 0 0 0 1 1 0 0 20 0 5 0 1130053681 29069312 6160 4294967295 134512640 135180984 3219444128 3086708808 134675846 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=28388 CPUtime=0.02
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 2281 0 0 0 1 1 0 0 19 0 5 0 1130053681 29069312 6161 4294967295 134512640 135180984 3219444128 3086643488 134513568 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=28388 CPUtime=0
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 1567 0 0 0 0 0 0 0 20 0 5 0 1130053681 29069312 6162 4294967295 134512640 135180984 3219444128 3086577956 134583077 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 28388

[startup+0.106922 s]
/proc/loadavg: 2.75 2.91 2.95 3/115 19103
/proc/meminfo: memFree=2923320/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=45136 CPUtime=0.24
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 10033 0 0 0 21 3 0 0 18 0 5 0 1130053681 46219264 9973 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 11284 9975 63 164 0 11119 0
[pid=19103/tid=19104] ppid=19101 vsize=45136 CPUtime=0
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130053681 46219264 9976 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=45136 CPUtime=0.09
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 3286 0 0 0 8 1 0 0 19 0 5 0 1130053681 46219264 9977 4294967295 134512640 135180984 3219444128 3086708808 134675846 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=45136 CPUtime=0.08
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 3391 0 0 0 6 2 0 0 19 0 5 0 1130053681 46219264 9977 4294967295 134512640 135180984 3219444128 3086643288 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=45136 CPUtime=0.07
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 3242 0 0 0 7 0 0 0 20 0 5 0 1130053681 46219264 9977 4294967295 134512640 135180984 3219444128 3086577812 134579486 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 45136

[startup+0.307133 s]
/proc/loadavg: 2.75 2.91 2.95 3/115 19103
/proc/meminfo: memFree=2923320/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=91128 CPUtime=0.84
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 19260 0 0 0 75 9 0 0 18 0 5 0 1130053681 93315072 19200 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 22782 19200 63 164 0 22617 0
[pid=19103/tid=19104] ppid=19101 vsize=91128 CPUtime=0
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130053681 93315072 19200 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=91128 CPUtime=0.29
/proc/19103/task/19105/stat : 19105 (satake) D 19101 19103 11369 0 -1 4202560 6246 0 0 0 25 4 0 0 18 0 5 0 1130053681 93315072 19200 4294967295 134512640 135180984 3219444128 3086708816 134702260 0 0 0 0 3223098951 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=91128 CPUtime=0.28
/proc/19103/task/19106/stat : 19106 (satake) D 19101 19103 11369 0 -1 4202560 6538 0 0 0 25 3 0 0 17 0 5 0 1130053681 93315072 19200 4294967295 134512640 135180984 3219444128 3086643456 134522268 0 0 0 0 3223098951 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=91128 CPUtime=0.27
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 6358 0 0 0 25 2 0 0 18 0 5 0 1130053681 93315072 19200 4294967295 134512640 135180984 3219444128 3086577876 134579745 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.84
Current children cumulated vsize (KiB) 91128

[startup+0.706838 s]
/proc/loadavg: 2.75 2.91 2.95 3/115 19103
/proc/meminfo: memFree=2923320/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=138336 CPUtime=2.03
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 34427 0 0 0 190 13 0 0 18 0 5 0 1130053681 141656064 27836 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 34584 27836 66 164 0 34419 0
[pid=19103/tid=19104] ppid=19101 vsize=138336 CPUtime=0.04
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 2979 0 0 0 3 1 0 0 16 0 5 0 1130053681 141656064 27837 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=138336 CPUtime=0.68
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 10498 0 0 0 62 6 0 0 17 0 5 0 1130053681 141656064 27837 4294967295 134512640 135180984 3219444128 3086708308 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=138336 CPUtime=0.64
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 10377 0 0 0 60 4 0 0 17 0 5 0 1130053681 141656064 27837 4294967295 134512640 135180984 3219444128 3086643056 134528719 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=138336 CPUtime=0.67
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 10463 0 0 0 65 2 0 0 17 0 5 0 1130053681 141656064 27837 4294967295 134512640 135180984 3219444128 3086577520 134528209 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.03
Current children cumulated vsize (KiB) 138336

[startup+1.50681 s]
/proc/loadavg: 2.75 2.91 2.95 4/120 19108
/proc/meminfo: memFree=2811728/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=138468 CPUtime=4.43
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 34630 0 0 0 425 18 0 0 18 0 5 0 1130053681 141791232 28039 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 34617 28039 68 164 0 34452 0
[pid=19103/tid=19104] ppid=19101 vsize=138468 CPUtime=0.08
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 2983 0 0 0 6 2 0 0 15 0 5 0 1130053681 141791232 28039 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=138468 CPUtime=1.48
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 10578 0 0 0 140 8 0 0 18 0 5 0 1130053681 141791232 28039 4294967295 134512640 135180984 3219444128 3086708584 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=138468 CPUtime=1.4
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 10427 0 0 0 135 5 0 0 18 0 5 0 1130053681 141791232 28039 4294967295 134512640 135180984 3219444128 3086643056 134528080 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=138468 CPUtime=1.47
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 10531 0 0 0 144 3 0 0 18 0 5 0 1130053681 141791232 28039 4294967295 134512640 135180984 3219444128 3086577520 134528861 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4.43
Current children cumulated vsize (KiB) 138468

[startup+3.10674 s]
/proc/loadavg: 2.75 2.91 2.95 4/120 19108
/proc/meminfo: memFree=2811568/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=139760 CPUtime=9.2
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 34866 0 0 0 884 36 0 0 18 0 5 0 1130053681 143114240 28275 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 34940 28275 68 164 0 34775 0
[pid=19103/tid=19104] ppid=19101 vsize=139760 CPUtime=0.21
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 3006 0 0 0 9 12 0 0 15 0 5 0 1130053681 143114240 28275 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=139760 CPUtime=3.07
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 10628 0 0 0 292 15 0 0 19 0 5 0 1130053681 143114240 28275 4294967295 134512640 135180984 3219444128 3086708592 134526635 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=139760 CPUtime=2.87
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 10489 0 0 0 282 5 0 0 20 0 5 0 1130053681 143114240 28275 4294967295 134512640 135180984 3219444128 3086643056 134528211 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=139760 CPUtime=3.05
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 10632 0 0 0 301 4 0 0 20 0 5 0 1130053681 143114240 28275 4294967295 134512640 135180984 3219444128 3086577456 134523641 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 9.2
Current children cumulated vsize (KiB) 139760

[startup+6.30662 s]
/proc/loadavg: 2.77 2.91 2.95 4/120 19108
/proc/meminfo: memFree=2809120/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=142664 CPUtime=18.76
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 35509 0 0 0 1800 76 0 0 18 0 5 0 1130053681 146087936 28918 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 35666 28918 68 164 0 35501 0
[pid=19103/tid=19104] ppid=19101 vsize=142664 CPUtime=0.51
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 3088 0 0 0 19 32 0 0 16 0 5 0 1130053681 146087936 28918 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=142664 CPUtime=6.25
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 10850 0 0 0 602 23 0 0 25 0 5 0 1130053681 146087936 28918 4294967295 134512640 135180984 3219444128 3086708592 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=142664 CPUtime=5.76
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 10640 0 0 0 565 11 0 0 25 0 5 0 1130053681 146087936 28918 4294967295 134512640 135180984 3219444128 3086643056 134528262 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=142664 CPUtime=6.24
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 10820 0 0 0 614 10 0 0 25 0 5 0 1130053681 146087936 28918 4294967295 134512640 135180984 3219444128 3086577520 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 18.76
Current children cumulated vsize (KiB) 142664

[startup+12.7064 s]
/proc/loadavg: 2.79 2.91 2.95 4/120 19109
/proc/meminfo: memFree=2802856/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=150004 CPUtime=37.87
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 37232 0 0 0 3640 147 0 0 18 0 5 0 1130053681 153604096 30641 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 37501 30641 68 164 0 37336 0
[pid=19103/tid=19104] ppid=19101 vsize=150004 CPUtime=1
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 3325 0 0 0 32 68 0 0 16 0 5 0 1130053681 153604096 30641 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=150004 CPUtime=12.61
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 11551 0 0 0 1222 39 0 0 25 0 5 0 1130053681 153604096 30641 4294967295 134512640 135180984 3219444128 3086708592 134528869 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=150004 CPUtime=11.67
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 10966 0 0 0 1144 23 0 0 25 0 5 0 1130053681 153604096 30641 4294967295 134512640 135180984 3219444128 3086643056 134528209 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=150004 CPUtime=12.59
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 11279 0 0 0 1242 17 0 0 25 0 5 0 1130053681 153604096 30641 4294967295 134512640 135180984 3219444128 3086577516 134518246 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37.87
Current children cumulated vsize (KiB) 150004

[startup+25.5058 s]
/proc/loadavg: 2.91 2.93 2.95 4/120 19113
/proc/meminfo: memFree=2788348/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=163560 CPUtime=77.33
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 40764 0 0 0 7334 399 0 0 18 0 5 0 1130053681 167485440 34173 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 40890 34173 68 164 0 40725 0
[pid=19103/tid=19104] ppid=19101 vsize=163560 CPUtime=2.61
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 3911 0 0 0 73 188 0 0 16 0 5 0 1130053681 167485440 34173 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=163560 CPUtime=25.32
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 12513 0 0 0 2437 95 0 0 25 0 5 0 1130053681 167485440 34173 4294967295 134512640 135180984 3219444128 3086708592 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=163560 CPUtime=24.13
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 11783 0 0 0 2337 76 0 0 25 0 5 0 1130053681 167485440 34173 4294967295 134512640 135180984 3219444128 3086643072 134518634 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=163560 CPUtime=25.27
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 12446 0 0 0 2487 40 0 0 25 0 5 0 1130053681 167485440 34173 4294967295 134512640 135180984 3219444128 3086577416 134519077 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 77.33
Current children cumulated vsize (KiB) 163560

[startup+51.1148 s]
/proc/loadavg: 3.00 2.95 2.96 4/120 19115
/proc/meminfo: memFree=2762584/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=190636 CPUtime=156.61
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 47333 0 0 0 14774 887 0 0 18 0 5 0 1130053681 195211264 40742 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 47659 40742 68 164 0 47494 0
[pid=19103/tid=19104] ppid=19101 vsize=190636 CPUtime=5.59
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 4929 0 0 0 140 419 0 0 16 0 5 0 1130053681 195211264 40742 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=190636 CPUtime=50.8
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 14574 0 0 0 4880 200 0 0 25 0 5 0 1130053681 195211264 40742 4294967295 134512640 135180984 3219444128 3086708608 134518615 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=190636 CPUtime=49.64
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 13486 0 0 0 4796 168 0 0 25 0 5 0 1130053681 195211264 40742 4294967295 134512640 135180984 3219444128 3086642980 134521133 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=190636 CPUtime=50.58
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 14233 0 0 0 4958 100 0 0 25 0 5 0 1130053681 195211264 40742 4294967295 134512640 135180984 3219444128 3086577516 134518246 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 156.61
Current children cumulated vsize (KiB) 190636

[startup+102.313 s]
/proc/loadavg: 3.00 2.96 2.96 4/120 19303

################
# More data... #
################

[pid=19103/tid=19105] ppid=19101 vsize=444240 CPUtime=519.82
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 33708 0 0 0 51057 925 0 0 25 0 5 0 1130053681 454901760 103355 4294967295 134512640 135180984 3219444128 3086708592 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=444240 CPUtime=519.38
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 30168 0 0 0 51047 891 0 0 25 0 5 0 1130053681 454901760 103355 4294967295 134512640 135180984 3219444128 3086642992 134523794 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=444240 CPUtime=513.51
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 33017 0 0 0 50835 516 0 0 25 0 5 0 1130053681 454901760 103355 4294967295 134512640 135180984 3219444128 3086577456 134523862 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1581.14
Current children cumulated vsize (KiB) 444240

[startup+582.314 s]
/proc/loadavg: 3.07 3.04 2.99 4/120 20808
/proc/meminfo: memFree=2485864/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=467952 CPUtime=1760.87
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 115923 0 0 0 171425 4662 0 0 18 0 5 0 1130053681 479182848 109332 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 116988 109332 68 164 0 116823 0
[pid=19103/tid=19104] ppid=19101 vsize=467952 CPUtime=29.6
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 13426 0 0 0 731 2229 0 0 15 0 5 0 1130053681 479182848 109332 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=467952 CPUtime=579.67
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 35876 0 0 0 57001 966 0 0 25 0 5 0 1130053681 479182848 109332 4294967295 134512640 135180984 3219444128 3086708560 134520027 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=467952 CPUtime=579.14
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 31657 0 0 0 56983 931 0 0 25 0 5 0 1130053681 479182848 109332 4294967295 134512640 135180984 3219444128 3086643048 134518224 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=467952 CPUtime=572.46
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 34853 0 0 0 56710 536 0 0 25 0 5 0 1130053681 479182848 109332 4294967295 134512640 135180984 3219444128 3086577520 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1760.87
Current children cumulated vsize (KiB) 467952

[startup+642.311 s]
/proc/loadavg: 3.06 3.04 2.99 4/120 20996
/proc/meminfo: memFree=2468752/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=485140 CPUtime=1941.23
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 120341 0 0 0 189347 4776 0 0 18 0 5 0 1130053681 496783360 113750 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 121285 113750 68 164 0 121120 0
[pid=19103/tid=19104] ppid=19101 vsize=485140 CPUtime=30.27
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 13614 0 0 0 743 2284 0 0 16 0 5 0 1130053681 496783360 113750 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=485140 CPUtime=639.59
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 37462 0 0 0 62982 977 0 0 25 0 5 0 1130053681 496783360 113750 4294967295 134512640 135180984 3219444128 3086708560 134520027 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=485140 CPUtime=639.03
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 32717 0 0 0 62949 954 0 0 25 0 5 0 1130053681 496783360 113750 4294967295 134512640 135180984 3219444128 3086643056 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=485140 CPUtime=632.34
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 36437 0 0 0 62673 561 0 0 25 0 5 0 1130053681 496783360 113750 4294967295 134512640 135180984 3219444128 3086577520 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1941.23
Current children cumulated vsize (KiB) 485140

[startup+702.309 s]
/proc/loadavg: 3.06 3.05 3.00 4/120 21189
/proc/meminfo: memFree=2450268/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=505600 CPUtime=2121.6
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 124857 0 0 0 207283 4877 0 0 18 0 5 0 1130053681 517734400 118266 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 126400 118266 68 164 0 126235 0
[pid=19103/tid=19104] ppid=19101 vsize=505600 CPUtime=30.87
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 13885 0 0 0 754 2333 0 0 16 0 5 0 1130053681 517734400 118266 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=505600 CPUtime=699.53
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 38900 0 0 0 68968 985 0 0 25 0 5 0 1130053681 517734400 118266 4294967295 134512640 135180984 3219444128 3086708592 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=505600 CPUtime=698.94
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 34124 0 0 0 68919 975 0 0 25 0 5 0 1130053681 517734400 118266 4294967295 134512640 135180984 3219444128 3086643056 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=505600 CPUtime=692.26
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 37837 0 0 0 68642 584 0 0 25 0 5 0 1130053681 517734400 118266 4294967295 134512640 135180984 3219444128 3086577520 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2121.6
Current children cumulated vsize (KiB) 505600

[startup+762.306 s]
/proc/loadavg: 3.06 3.05 3.00 4/120 21375
/proc/meminfo: memFree=2434032/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=522736 CPUtime=2302.11
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 128986 0 0 0 225207 5004 0 0 18 0 5 0 1130053681 535281664 122395 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 130684 122395 68 164 0 130519 0
[pid=19103/tid=19104] ppid=19101 vsize=522736 CPUtime=31.67
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 14148 0 0 0 770 2397 0 0 16 0 5 0 1130053681 535281664 122395 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=522736 CPUtime=759.49
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 40338 0 0 0 74956 993 0 0 25 0 5 0 1130053681 535281664 122395 4294967295 134512640 135180984 3219444128 3086708592 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=522736 CPUtime=758.76
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 35105 0 0 0 74876 1000 0 0 25 0 5 0 1130053681 535281664 122395 4294967295 134512640 135180984 3219444128 3086643056 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=522736 CPUtime=752.19
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 39284 0 0 0 74605 614 0 0 25 0 5 0 1130053681 535281664 122395 4294967295 134512640 135180984 3219444128 3086577520 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2302.11
Current children cumulated vsize (KiB) 522736

[startup+822.314 s]
/proc/loadavg: 3.13 3.07 3.01 4/120 21563
/proc/meminfo: memFree=2419276/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=537832 CPUtime=2482.55
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 132720 0 0 0 243130 5125 0 0 18 0 5 0 1130053681 550739968 126129 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 134458 126129 68 164 0 134293 0
[pid=19103/tid=19104] ppid=19101 vsize=537832 CPUtime=32.3
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 14389 0 0 0 779 2451 0 0 16 0 5 0 1130053681 550739968 126129 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=537832 CPUtime=819.45
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 41596 0 0 0 80944 1001 0 0 25 0 5 0 1130053681 550739968 126129 4294967295 134512640 135180984 3219444128 3086708584 134520863 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=537832 CPUtime=818.69
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 36215 0 0 0 80847 1022 0 0 25 0 5 0 1130053681 550739968 126129 4294967295 134512640 135180984 3219444128 3086643056 134526964 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=537832 CPUtime=812.11
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 40409 0 0 0 80560 651 0 0 25 0 5 0 1130053681 550739968 126129 4294967295 134512640 135180984 3219444128 3086577520 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2482.55
Current children cumulated vsize (KiB) 537832

[startup+882.312 s]
/proc/loadavg: 3.12 3.07 3.00 4/120 21751
/proc/meminfo: memFree=2405388/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=556276 CPUtime=2662.88
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 136041 0 0 0 261050 5238 0 0 18 0 5 0 1130053681 569626624 129450 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 139069 129450 68 164 0 138904 0
[pid=19103/tid=19104] ppid=19101 vsize=556276 CPUtime=32.92
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 14645 0 0 0 791 2501 0 0 16 0 5 0 1130053681 569626624 129450 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=556276 CPUtime=879.34
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 42705 0 0 0 86928 1006 0 0 25 0 5 0 1130053681 569626624 129450 4294967295 134512640 135180984 3219444128 3086708608 134532624 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=556276 CPUtime=878.61
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 37115 0 0 0 86813 1048 0 0 25 0 5 0 1130053681 569626624 129450 4294967295 134512640 135180984 3219444128 3086643056 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=556276 CPUtime=872.01
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 41465 0 0 0 86518 683 0 0 25 0 5 0 1130053681 569626624 129450 4294967295 134512640 135180984 3219444128 3086577520 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2662.88
Current children cumulated vsize (KiB) 556276

[startup+942.309 s]
/proc/loadavg: 3.15 3.08 3.01 4/120 21939
/proc/meminfo: memFree=2390880/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=570132 CPUtime=2843.35
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 139691 0 0 0 278979 5356 0 0 18 0 5 0 1130053681 583815168 133100 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 142533 133100 68 164 0 142368 0
[pid=19103/tid=19104] ppid=19101 vsize=570132 CPUtime=33.61
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 14941 0 0 0 805 2556 0 0 16 0 5 0 1130053681 583815168 133100 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=570132 CPUtime=939.28
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 44037 0 0 0 92915 1013 0 0 25 0 5 0 1130053681 583815168 133100 4294967295 134512640 135180984 3219444128 3086708592 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=570132 CPUtime=938.53
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 37909 0 0 0 92778 1075 0 0 25 0 5 0 1130053681 583815168 133100 4294967295 134512640 135180984 3219444128 3086643056 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=570132 CPUtime=931.93
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 42693 0 0 0 92481 712 0 0 25 0 5 0 1130053681 583815168 133100 4294967295 134512640 135180984 3219444128 3086577520 134528211 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2843.35
Current children cumulated vsize (KiB) 570132



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.02 s]
/proc/loadavg: 3.12 3.08 3.01 4/120 22130
/proc/meminfo: memFree=2375992/3368532 swapFree=1941392/1959888
[pid=19103] ppid=19101 vsize=589144 CPUtime=3016.88
/proc/19103/stat : 19103 (satake) S 19101 19103 11369 0 -1 4202496 143371 0 0 0 296237 5451 0 0 18 0 5 0 1130053681 603283456 136772 4294967295 134512640 135180984 3219444128 3219443564 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/19103/statm: 147286 136772 68 164 0 147121 0
[pid=19103/tid=19104] ppid=19101 vsize=589144 CPUtime=34.21
/proc/19103/task/19104/stat : 19104 (satake) S 19101 19103 11369 0 -1 4202560 15131 0 0 0 821 2600 0 0 16 0 5 0 1130053681 603283456 136772 4294967295 134512640 135180984 3219444128 3086774288 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=589144 CPUtime=996.93
/proc/19103/task/19105/stat : 19105 (satake) R 19101 19103 11369 0 -1 4202560 45098 0 0 0 98672 1021 0 0 25 0 5 0 1130053681 603283456 136772 4294967295 134512640 135180984 3219444128 3086708592 134528211 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=589144 CPUtime=996.17
/proc/19103/task/19106/stat : 19106 (satake) R 19101 19103 11369 0 -1 4202560 39080 0 0 0 98520 1097 0 0 25 0 5 0 1130053681 603283456 136772 4294967295 134512640 135180984 3219444128 3086642888 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=19103/tid=19107] ppid=19101 vsize=589144 CPUtime=989.57
/proc/19103/task/19107/stat : 19107 (satake) R 19101 19103 11369 0 -1 4202560 43951 0 0 0 98224 733 0 0 25 0 5 0 1130053681 603283456 136772 4294967295 134512640 135180984 3219444128 3086577520 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3016.88
Current children cumulated vsize (KiB) 589144

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.07
CPU time (s): 3016.97
CPU user time (s): 2962.43
CPU system time (s): 54.54
CPU usage (%): 301.676
Max. virtual memory (cumulated for all children) (KiB): 589144

deleting IPC queue 28311552
deleting IPC queue 28344321
deleting IPC queue 28377090
deleting IPC queue 28409859
deleting IPC queue 28442628
deleting IPC queue 28475397
deleting IPC queue 28508166
deleting IPC queue 28540935
deleting IPC queue 28573704
deleting IPC queue 28606473
deleting IPC queue 28639242
deleting IPC queue 28672011
deleting IPC queue 28704780
deleting IPC queue 28737549
deleting IPC queue 28770318
deleting IPC queue 28803087

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2962.43
system time used= 54.54
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 143371
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2279657
involuntary context switches= 1085220

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 05:22:18
IDJOB=1781290
IDBENCH=71715
IDSOLVER=629
FILE ID=/1781290-1243653738
PBS_JOBID=
Free space on /tmp= 15722 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT_RACE06/manol-pipe-c7nidw.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781290-1243653738/watcher-1781290-1243653738 -o /tmp/evaluation-result-1781290-1243653738/solver-1781290-1243653738 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1781290-1243653738.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= cddc29f8f256e39e02d9b418f68e802c
RANDOM SEED= 1920249877

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2923320 kB
Buffers:         51268 kB
Cached:         308168 kB
SwapCached:       4320 kB
Active:         151456 kB
Inactive:       218368 kB
HighTotal:     2489216 kB
HighFree:      2168392 kB
LowTotal:       879316 kB
LowFree:        754928 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            9728 kB
Writeback:           0 kB
AnonPages:        9248 kB
Mapped:           4360 kB
Slab:            65108 kB
SReclaimable:    56096 kB
SUnreclaim:       9012 kB
PageTables:        748 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127072 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15721 MiB
End job on  at 2009-05-30 05:39:01