Trace number 1780945

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 1981.99 1000.07

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_21_SAT.cnf
MD5SUM03a36a0e1b9af8e7c30a29a92e02302e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark65.2441
Satisfiable
(Un)Satisfiability was proved
Number of variables4466
Number of clauses542457
Sum of the clauses size1621186
Maximum clause length22
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 26774
Number of clauses of size 3535652
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780945-1243651569/watcher-1780945-1243651569 -o /tmp/evaluation-result-1780945-1243651569/solver-1780945-1243651569 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1780945-1243651569.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 5.33 5.45 5.37 7/120 14323
/proc/meminfo: memFree=3067600/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=1096 CPUtime=0
/proc/14320/stat : 14320 (satake) R 14318 14320 17312 0 -1 4202496 111 0 0 0 0 0 0 0 21 0 4 0 1129819795 1122304 67 4294967295 134512640 135180984 3218678000 3218677344 134705812 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 274 67 54 164 0 109 0
[pid=14320/tid=14321] ppid=14318 vsize=1096 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) R 14318 14320 17312 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 1129819795 1122304 67 4294967295 134512640 135180984 3218678000 3086275396 134705812 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=1096 CPUtime=0
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 1129819795 1122304 67 4294967295 134512640 135180984 3218678000 3086209860 134705812 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=1096 CPUtime=0
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 1129819795 1122304 67 4294967295 134512640 135180984 3218678000 3086144324 134705812 0 0 0 0 0 0 0 -1 0 0 0 0

[startup+0.055862 s]
/proc/loadavg: 5.33 5.45 5.37 7/120 14323
/proc/meminfo: memFree=3067600/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=23576 CPUtime=0.08
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 5467 0 0 0 5 3 0 0 21 0 5 0 1129819795 24141824 5414 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 5894 5414 63 164 0 5729 0
[pid=14320/tid=14321] ppid=14318 vsize=23576 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 7 0 0 0 0 0 0 0 22 0 5 0 1129819795 24141824 5414 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=23576 CPUtime=0.05
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 2628 0 0 0 3 2 0 0 23 0 5 0 1129819795 24141824 5415 4294967295 134512640 135180984 3218678000 3086209248 134519935 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=23576 CPUtime=0.03
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 2651 0 0 0 2 1 0 0 22 0 5 0 1129819795 24141824 5415 4294967295 134512640 135180984 3218678000 3086143576 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 23576

[startup+0.107649 s]
/proc/loadavg: 5.33 5.45 5.37 7/120 14323
/proc/meminfo: memFree=3067600/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=29224 CPUtime=0.19
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 6776 0 0 0 16 3 0 0 21 0 5 0 1129819795 29925376 6723 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 7306 6723 63 164 0 7141 0
[pid=14320/tid=14321] ppid=14318 vsize=29224 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 7 0 0 0 0 0 0 0 22 0 5 0 1129819795 29925376 6723 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=29224 CPUtime=0.1
/proc/14320/task/14322/stat : 14322 (satake) D 14318 14320 17312 0 -1 4202560 3258 0 0 0 8 2 0 0 22 0 5 0 1129819795 29925376 6723 4294967295 134512640 135180984 3218678000 3086209104 134702260 0 0 0 0 3223098951 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=29224 CPUtime=0.09
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 3304 0 0 0 8 1 0 0 22 0 5 0 1129819795 29925376 6725 4294967295 134512640 135180984 3218678000 3086143460 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 29224

[startup+0.305848 s]
/proc/loadavg: 5.33 5.45 5.37 7/120 14323
/proc/meminfo: memFree=3067600/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=57044 CPUtime=0.56
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 13876 0 0 0 50 6 0 0 21 0 5 0 1129819795 58413056 13819 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 14294 13822 63 164 0 14129 0
[pid=14320/tid=14321] ppid=14318 vsize=57176 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 7 0 0 0 0 0 0 0 22 0 5 0 1129819795 58548224 13823 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=57176 CPUtime=0.26
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 5292 0 0 0 24 2 0 0 22 0 5 0 1129819795 58548224 13824 4294967295 134512640 135180984 3218678000 3086208996 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=57176 CPUtime=0.12
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 3891 0 0 0 10 2 0 0 22 0 5 0 1129819795 58548224 13825 4294967295 134512640 135180984 3218678000 3086143636 134579486 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.56
Current children cumulated vsize (KiB) 57044

[startup+0.705834 s]
/proc/loadavg: 5.33 5.45 5.37 7/120 14323
/proc/meminfo: memFree=3067600/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=68692 CPUtime=1.35
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 23102 0 0 0 127 8 0 0 21 0 5 0 1129819795 70340608 16177 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 17173 16177 68 164 0 17008 0
[pid=14320/tid=14321] ppid=14318 vsize=68692 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 0 0 0 0 16 0 5 0 1129819795 70340608 16177 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=68692 CPUtime=0.48
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 7572 0 0 0 46 2 0 0 23 0 5 0 1129819795 70340608 16177 4294967295 134512640 135180984 3218678000 3086208880 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=68692 CPUtime=0.43
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 7663 0 0 0 41 2 0 0 21 0 5 0 1129819795 70340608 16177 4294967295 134512640 135180984 3218678000 3086143060 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.35
Current children cumulated vsize (KiB) 68692

[startup+1.50582 s]
/proc/loadavg: 5.33 5.45 5.37 6/122 14325
/proc/meminfo: memFree=3001592/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=72952 CPUtime=2.94
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 24049 0 0 0 286 8 0 0 21 0 5 0 1129819795 74702848 17124 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 18238 17124 68 164 0 18073 0
[pid=14320/tid=14321] ppid=14318 vsize=72952 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 0 0 0 0 15 0 5 0 1129819795 74702848 17124 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=72952 CPUtime=0.71
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 7736 0 0 0 69 2 0 0 24 0 5 0 1129819795 74702848 17124 4294967295 134512640 135180984 3218678000 3086208876 134518246 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=72952 CPUtime=1.14
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 8063 0 0 0 112 2 0 0 22 0 5 0 1129819795 74702848 17124 4294967295 134512640 135180984 3218678000 3086143244 134518246 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=72952 CPUtime=1.09
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 8053 0 0 0 105 4 0 0 25 0 5 0 1129819796 74702848 17124 4294967295 134512640 135180984 3218678000 3086069488 134522706 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.94
Current children cumulated vsize (KiB) 72952

[startup+3.1057 s]
/proc/loadavg: 5.33 5.45 5.37 6/122 14325
/proc/meminfo: memFree=2997176/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=77872 CPUtime=5.88
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 25354 0 0 0 580 8 0 0 21 0 5 0 1129819795 79740928 18429 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 19468 18429 68 164 0 19303 0
[pid=14320/tid=14321] ppid=14318 vsize=77872 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 0 0 0 0 15 0 5 0 1129819795 79740928 18429 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=77872 CPUtime=1.39
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 8086 0 0 0 137 2 0 0 25 0 5 0 1129819795 79740928 18429 4294967295 134512640 135180984 3218678000 3086208672 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=77872 CPUtime=2.13
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 8468 0 0 0 211 2 0 0 25 0 5 0 1129819795 79740928 18429 4294967295 134512640 135180984 3218678000 3086143344 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=77872 CPUtime=2.36
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 8603 0 0 0 232 4 0 0 25 0 5 0 1129819796 79740928 18429 4294967295 134512640 135180984 3218678000 3086069616 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.88
Current children cumulated vsize (KiB) 77872

[startup+6.30554 s]
/proc/loadavg: 5.23 5.42 5.37 6/122 14333
/proc/meminfo: memFree=2987448/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=86328 CPUtime=11.5
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 27584 0 0 0 1140 10 0 0 21 0 5 0 1129819795 88399872 20659 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 21582 20659 68 164 0 21417 0
[pid=14320/tid=14321] ppid=14318 vsize=86328 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 0 0 0 0 15 0 5 0 1129819795 88399872 20659 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=86328 CPUtime=3.17
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 8895 0 0 0 315 2 0 0 25 0 5 0 1129819795 88399872 20659 4294967295 134512640 135180984 3218678000 3086208672 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=86328 CPUtime=3.98
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 9133 0 0 0 395 3 0 0 25 0 5 0 1129819795 88399872 20659 4294967295 134512640 135180984 3218678000 3086143176 134675767 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=86328 CPUtime=4.35
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 9359 0 0 0 430 5 0 0 25 0 5 0 1129819796 88399872 20659 4294967295 134512640 135180984 3218678000 3086069612 134520661 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.5
Current children cumulated vsize (KiB) 86328

[startup+12.7052 s]
/proc/loadavg: 5.21 5.42 5.36 5/122 14342
/proc/meminfo: memFree=2969684/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=103600 CPUtime=23.18
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 31856 0 0 0 2304 14 0 0 21 0 5 0 1129819795 106086400 24931 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 25900 24931 68 164 0 25735 0
[pid=14320/tid=14321] ppid=14318 vsize=103600 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 0 0 0 0 15 0 5 0 1129819795 106086400 24931 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=103600 CPUtime=7.22
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 10468 0 0 0 718 4 0 0 25 0 5 0 1129819795 106086400 24931 4294967295 134512640 135180984 3218678000 3086208720 134691935 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=103600 CPUtime=7.72
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 10563 0 0 0 767 5 0 0 25 0 5 0 1129819795 106086400 24931 4294967295 134512640 135180984 3218678000 3086143136 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=103600 CPUtime=8.24
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 10628 0 0 0 819 5 0 0 25 0 5 0 1129819796 106086400 24931 4294967295 134512640 135180984 3218678000 3086069520 134525358 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.18
Current children cumulated vsize (KiB) 103600

[startup+25.5046 s]
/proc/loadavg: 5.16 5.40 5.36 6/122 14363
/proc/meminfo: memFree=2942420/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=129568 CPUtime=47.8
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 38367 0 0 0 4765 15 0 0 21 0 5 0 1129819795 132677632 31442 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 32392 31442 68 164 0 32227 0
[pid=14320/tid=14321] ppid=14318 vsize=129568 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 0 0 0 0 15 0 5 0 1129819795 132677632 31442 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=129568 CPUtime=14.27
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 12853 0 0 0 1423 4 0 0 25 0 5 0 1129819795 132677632 31442 4294967295 134512640 135180984 3218678000 3086208712 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=129568 CPUtime=16.11
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 12800 0 0 0 1605 6 0 0 25 0 5 0 1129819795 132677632 31442 4294967295 134512640 135180984 3218678000 3086143136 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=129568 CPUtime=17.42
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 12517 0 0 0 1737 5 0 0 25 0 5 0 1129819796 132677632 31442 4294967295 134512640 135180984 3218678000 3086069616 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 47.8
Current children cumulated vsize (KiB) 129568

[startup+51.1032 s]
/proc/loadavg: 5.33 5.41 5.36 6/122 14584
/proc/meminfo: memFree=2907512/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=164116 CPUtime=98.03
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 47040 0 0 0 9787 16 0 0 21 0 5 0 1129819795 168054784 40115 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 41029 40115 68 164 0 40864 0
[pid=14320/tid=14321] ppid=14318 vsize=164116 CPUtime=0
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 0 0 0 0 15 0 5 0 1129819795 168054784 40115 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=164116 CPUtime=27.43
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 16306 0 0 0 2739 4 0 0 25 0 5 0 1129819795 168054784 40115 4294967295 134512640 135180984 3218678000 3086208880 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=164116 CPUtime=37.78
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 15176 0 0 0 3771 7 0 0 25 0 5 0 1129819795 168054784 40115 4294967295 134512640 135180984 3218678000 3086143340 134518218 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=164116 CPUtime=32.82
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 15361 0 0 0 3277 5 0 0 25 0 5 0 1129819796 168054784 40115 4294967295 134512640 135180984 3218678000 3086069408 134580407 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 98.03
Current children cumulated vsize (KiB) 164116

[startup+102.321 s]
/proc/loadavg: 5.28 5.38 5.36 7/123 14769
/proc/meminfo: memFree=2851100/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=221916 CPUtime=198.49
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 60909 0 0 0 19826 23 0 0 21 0 5 0 1129819795 227241984 53984 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 55479 53984 68 164 0 55314 0
[pid=14320/tid=14321] ppid=14318 vsize=221916 CPUtime=0.01
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 0 1 0 0 15 0 5 0 1129819795 227241984 53984 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=221916 CPUtime=60.15
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 20844 0 0 0 6011 4 0 0 25 0 5 0 1129819795 227241984 53984 4294967295 134512640 135180984 3218678000 3086208712 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=221916 CPUtime=69.4
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 19625 0 0 0 6930 10 0 0 25 0 5 0 1129819795 227241984 53984 4294967295 134512640 135180984 3218678000 3086143136 134580407 0 0 0 0 0 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=14320/tid=14322] ppid=14318 vsize=532988 CPUtime=322.49
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 47110 0 0 0 32230 19 0 0 25 0 5 0 1129819795 545779712 130644 4294967295 134512640 135180984 3218678000 3086208880 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=532988 CPUtime=337.21
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 46625 0 0 0 33690 31 0 0 25 0 5 0 1129819795 545779712 130644 4294967295 134512640 135180984 3218678000 3086143344 134528680 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=532988 CPUtime=371.91
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 43637 0 0 0 37151 40 0 0 25 0 5 0 1129819796 545779712 130644 4294967295 134512640 135180984 3218678000 3086069408 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1031.71
Current children cumulated vsize (KiB) 532988

[startup+582.305 s]
/proc/loadavg: 5.36 5.39 5.36 6/122 16885
/proc/meminfo: memFree=2515084/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=564536 CPUtime=1151.03
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 145038 0 0 0 115000 103 0 0 21 0 5 0 1129819795 578084864 138113 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 141134 138113 68 164 0 140969 0
[pid=14320/tid=14321] ppid=14318 vsize=564536 CPUtime=0.1
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 2 8 0 0 15 0 5 0 1129819795 578084864 138113 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=564536 CPUtime=357.38
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 49368 0 0 0 35718 20 0 0 25 0 5 0 1129819795 578084864 138113 4294967295 134512640 135180984 3218678000 3086208880 134528680 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=564536 CPUtime=384.7
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 49904 0 0 0 38436 34 0 0 25 0 5 0 1129819795 578084864 138113 4294967295 134512640 135180984 3218678000 3086143344 134528688 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=564536 CPUtime=408.85
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 45569 0 0 0 40844 41 0 0 25 0 5 0 1129819796 578084864 138113 4294967295 134512640 135180984 3218678000 3086069616 134528658 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1151.03
Current children cumulated vsize (KiB) 564536

[startup+642.312 s]
/proc/loadavg: 5.44 5.42 5.37 6/122 17161
/proc/meminfo: memFree=2489736/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=591508 CPUtime=1270.6
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 151615 0 0 0 126953 107 0 0 21 0 5 0 1129819795 605704192 144690 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 147877 144690 68 164 0 147712 0
[pid=14320/tid=14321] ppid=14318 vsize=591508 CPUtime=0.1
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 2 8 0 0 15 0 5 0 1129819795 605704192 144690 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=591508 CPUtime=397.91
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 51351 0 0 0 39769 22 0 0 25 0 5 0 1129819795 605704192 144690 4294967295 134512640 135180984 3218678000 3086208872 134518214 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=591508 CPUtime=429.34
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 52787 0 0 0 42898 36 0 0 25 0 5 0 1129819795 605704192 144690 4294967295 134512640 135180984 3218678000 3086143344 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=591508 CPUtime=443.25
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 47280 0 0 0 44284 41 0 0 25 0 5 0 1129819796 605704192 144690 4294967295 134512640 135180984 3218678000 3086069616 134528648 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1270.6
Current children cumulated vsize (KiB) 591508

[startup+702.309 s]
/proc/loadavg: 5.65 5.48 5.39 6/122 17444
/proc/meminfo: memFree=2461936/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=619272 CPUtime=1390.03
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 158327 0 0 0 138889 114 0 0 21 0 5 0 1129819795 634134528 151402 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 154818 151402 68 164 0 154653 0
[pid=14320/tid=14321] ppid=14318 vsize=619272 CPUtime=0.1
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 2 8 0 0 15 0 5 0 1129819795 634134528 151402 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=619272 CPUtime=434.56
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 53488 0 0 0 43432 24 0 0 25 0 5 0 1129819795 634134528 151402 4294967295 134512640 135180984 3218678000 3086208880 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=619272 CPUtime=475.71
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 55705 0 0 0 47534 37 0 0 25 0 5 0 1129819795 634134528 151402 4294967295 134512640 135180984 3218678000 3086143344 134528756 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=619272 CPUtime=479.66
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 48937 0 0 0 47921 45 0 0 25 0 5 0 1129819796 634134528 151402 4294967295 134512640 135180984 3218678000 3086069616 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1390.03
Current children cumulated vsize (KiB) 619272

[startup+762.316 s]
/proc/loadavg: 5.71 5.53 5.41 6/122 17720
/proc/meminfo: memFree=2434912/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=646312 CPUtime=1509.39
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 165074 0 0 0 150823 116 0 0 21 0 5 0 1129819795 661823488 158149 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 161578 158149 68 164 0 161413 0
[pid=14320/tid=14321] ppid=14318 vsize=646312 CPUtime=0.1
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 2 8 0 0 15 0 5 0 1129819795 661823488 158149 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=646312 CPUtime=467.81
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 55645 0 0 0 46755 26 0 0 25 0 5 0 1129819795 661823488 158149 4294967295 134512640 135180984 3218678000 3086208880 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=646312 CPUtime=526.13
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 58817 0 0 0 52576 37 0 0 25 0 5 0 1129819795 661823488 158149 4294967295 134512640 135180984 3218678000 3086143176 134675767 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=646312 CPUtime=515.35
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 50415 0 0 0 51490 45 0 0 25 0 5 0 1129819796 661823488 158149 4294967295 134512640 135180984 3218678000 3086069616 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1509.39
Current children cumulated vsize (KiB) 646312

[startup+822.313 s]
/proc/loadavg: 5.35 5.46 5.39 6/122 17995
/proc/meminfo: memFree=2403656/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=678844 CPUtime=1628.68
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 172839 0 0 0 162747 121 0 0 21 0 5 0 1129819795 695136256 165914 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 169711 165914 68 164 0 169546 0
[pid=14320/tid=14321] ppid=14318 vsize=678844 CPUtime=0.1
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 2 8 0 0 15 0 5 0 1129819795 695136256 165914 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=678844 CPUtime=498.24
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 58857 0 0 0 49795 29 0 0 25 0 5 0 1129819795 695136256 165914 4294967295 134512640 135180984 3218678000 3086208672 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=678844 CPUtime=576.44
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 61453 0 0 0 57607 37 0 0 25 0 5 0 1129819795 695136256 165914 4294967295 134512640 135180984 3218678000 3086143344 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=678844 CPUtime=553.9
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 52332 0 0 0 55343 47 0 0 25 0 5 0 1129819796 695136256 165914 4294967295 134512640 135180984 3218678000 3086069616 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1628.68
Current children cumulated vsize (KiB) 678844

[startup+882.31 s]
/proc/loadavg: 5.36 5.43 5.38 6/122 18271
/proc/meminfo: memFree=2364108/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=718500 CPUtime=1747.69
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 182745 0 0 0 174642 127 0 0 21 0 5 0 1129819795 735744000 175820 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 179625 175820 68 164 0 179460 0
[pid=14320/tid=14321] ppid=14318 vsize=718500 CPUtime=0.11
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 3 8 0 0 15 0 5 0 1129819795 735744000 175820 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=718500 CPUtime=543.5
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 63110 0 0 0 54318 32 0 0 25 0 5 0 1129819795 735744000 175820 4294967295 134512640 135180984 3218678000 3086208876 134518218 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=718500 CPUtime=615.68
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 64572 0 0 0 61530 38 0 0 25 0 5 0 1129819795 735744000 175820 4294967295 134512640 135180984 3218678000 3086143344 134528519 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=718500 CPUtime=588.4
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 54866 0 0 0 58791 49 0 0 25 0 5 0 1129819796 735744000 175820 4294967295 134512640 135180984 3218678000 3086069408 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1747.69
Current children cumulated vsize (KiB) 718500

[startup+942.307 s]
/proc/loadavg: 5.26 5.40 5.37 6/122 18547
/proc/meminfo: memFree=2332264/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=750828 CPUtime=1867.18
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 190716 0 0 0 186582 136 0 0 21 0 5 0 1129819795 768847872 183791 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 187707 183791 68 164 0 187542 0
[pid=14320/tid=14321] ppid=14318 vsize=750828 CPUtime=0.11
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 3 8 0 0 15 0 5 0 1129819795 768847872 183791 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=750828 CPUtime=590.73
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 66040 0 0 0 59039 34 0 0 25 0 5 0 1129819795 768847872 183791 4294967295 134512640 135180984 3218678000 3086208876 134518208 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=750828 CPUtime=653.61
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 67014 0 0 0 65317 44 0 0 25 0 5 0 1129819795 768847872 183791 4294967295 134512640 135180984 3218678000 3086143136 134580407 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=750828 CPUtime=622.73
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 57465 0 0 0 62223 50 0 0 25 0 5 0 1129819796 768847872 183791 4294967295 134512640 135180984 3218678000 3086069616 134528648 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1867.18
Current children cumulated vsize (KiB) 750828



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000 s]
/proc/loadavg: 5.35 5.40 5.37 6/122 18819
/proc/meminfo: memFree=2305872/3368532 swapFree=1959840/1959888
[pid=14320] ppid=14318 vsize=776596 CPUtime=1981.93
/proc/14320/stat : 14320 (satake) S 14318 14320 17312 0 -1 4202496 197301 0 0 0 198046 147 0 0 21 0 5 0 1129819795 795234304 190376 4294967295 134512640 135180984 3218678000 3218677436 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/14320/statm: 194149 190376 68 164 0 193984 0
[pid=14320/tid=14321] ppid=14318 vsize=776596 CPUtime=0.11
/proc/14320/task/14321/stat : 14321 (satake) S 14318 14320 17312 0 -1 4202560 85 0 0 0 3 8 0 0 15 0 5 0 1129819795 795234304 190376 4294967295 134512640 135180984 3218678000 3086274576 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=14320/tid=14322] ppid=14318 vsize=776596 CPUtime=637.45
/proc/14320/task/14322/stat : 14322 (satake) R 14318 14320 17312 0 -1 4202560 67990 0 0 0 63706 39 0 0 25 0 5 0 1129819795 795234304 190376 4294967295 134512640 135180984 3218678000 3086208712 134675846 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14320/tid=14323] ppid=14318 vsize=776596 CPUtime=683.91
/proc/14320/task/14323/stat : 14323 (satake) R 14318 14320 17312 0 -1 4202560 69180 0 0 0 68345 46 0 0 25 0 5 0 1129819795 795234304 190376 4294967295 134512640 135180984 3218678000 3086143344 134528680 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14320/tid=14325] ppid=14318 vsize=776596 CPUtime=660.46
/proc/14320/task/14325/stat : 14325 (satake) R 14318 14320 17312 0 -1 4202560 59934 0 0 0 65992 54 0 0 25 0 5 0 1129819796 795234304 190376 4294967295 134512640 135180984 3218678000 3086069616 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1981.93
Current children cumulated vsize (KiB) 776596

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.07
CPU time (s): 1981.99
CPU user time (s): 1980.48
CPU system time (s): 1.51
CPU usage (%): 198.186
Max. virtual memory (cumulated for all children) (KiB): 776596

deleting IPC queue 15204352
deleting IPC queue 15237121
deleting IPC queue 15269890
deleting IPC queue 15302659
deleting IPC queue 15335428
deleting IPC queue 15368197
deleting IPC queue 15400966
deleting IPC queue 15433735
deleting IPC queue 15466504
deleting IPC queue 15499273
deleting IPC queue 15532042
deleting IPC queue 15564811
deleting IPC queue 15597580
deleting IPC queue 15630349
deleting IPC queue 15663118
deleting IPC queue 15695887

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1980.48
system time used= 1.51
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 197302
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 32258
involuntary context switches= 54864

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 04:46:09
IDJOB=1780945
IDBENCH=71081
IDSOLVER=629
FILE ID=/1780945-1243651569
PBS_JOBID=
Free space on /tmp= 7976 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_21_SAT.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780945-1243651569/watcher-1780945-1243651569 -o /tmp/evaluation-result-1780945-1243651569/solver-1780945-1243651569 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1780945-1243651569.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 03a36a0e1b9af8e7c30a29a92e02302e
RANDOM SEED= 2000828931

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3067600 kB
Buffers:         58392 kB
Cached:         135160 kB
SwapCached:          0 kB
Active:          90428 kB
Inactive:       125476 kB
HighTotal:     2489216 kB
HighFree:      2331596 kB
LowTotal:       879316 kB
LowFree:        736004 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:           10132 kB
Writeback:           0 kB
AnonPages:       22168 kB
Mapped:           8188 kB
Slab:            74160 kB
SReclaimable:    61820 kB
SUnreclaim:      12340 kB
PageTables:        792 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   123556 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 7975 MiB
End job on  at 2009-05-30 05:02:52