Trace number 1775845

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 1022.69 1000.05

General information on the benchmark

Nameindustrial/fuhs/medium/
AProVE07-09.cnf
MD5SUM50ed98553825ac1825482c1496260592
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark623.33
Satisfiable
(Un)Satisfiability was proved
Number of variables33582
Number of clauses160817
Sum of the clauses size423605
Maximum clause length4200
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2136464
Number of clauses of size 36536
Number of clauses of size 46374
Number of clauses of size 52328
Number of clauses of size over 59114

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1775845-1243633258/watcher-1775845-1243633258 -o /tmp/evaluation-result-1775845-1243633258/solver-1775845-1243633258 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1775845-1243633258.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.91 6.76 6.51 8/113 27022
/proc/meminfo: memFree=2005648/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=5260 CPUtime=0
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 770 0 0 0 0 0 0 0 18 0 5 0 1117463144 5386240 727 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 1315 731 63 164 0 1150 0
[pid=27022/tid=27023] ppid=27020 vsize=5260 CPUtime=0
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1117463144 5386240 764 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=5260 CPUtime=0
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 695 0 0 0 0 0 0 0 19 0 5 0 1117463144 5386240 769 4294967295 134512640 135180984 3216111216 3086156068 134583077 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=5260 CPUtime=0
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 5 0 1117463144 5386240 773 4294967295 134512640 135180984 3216111216 3086091076 134705812 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=5260 CPUtime=0
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1117463144 5386240 779 4294967295 134512640 135180984 3216111216 3086025540 134705812 0 0 0 0 0 0 0 -1 2 0 0 0

[startup+0.079985 s]
/proc/loadavg: 6.91 6.76 6.51 8/113 27022
/proc/meminfo: memFree=2005648/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=28708 CPUtime=0.07
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 4323 0 0 0 6 1 0 0 18 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 7177 4280 63 164 0 7012 0
[pid=27022/tid=27023] ppid=27020 vsize=28708 CPUtime=0
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=28708 CPUtime=0.01
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 1118 0 0 0 1 0 0 0 19 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3086155848 134675824 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=28708 CPUtime=0.01
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 1129 0 0 0 0 1 0 0 19 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3086090312 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=28708 CPUtime=0.05
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 1959 0 0 0 5 0 0 0 20 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3086024992 134513615 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 28708

[startup+0.109992 s]
/proc/loadavg: 6.91 6.76 6.51 8/113 27022
/proc/meminfo: memFree=2005648/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=28708 CPUtime=0.07
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 4323 0 0 0 6 1 0 0 18 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 7177 4280 63 164 0 7012 0
[pid=27022/tid=27023] ppid=27020 vsize=28708 CPUtime=0
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=28708 CPUtime=0.01
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 1118 0 0 0 1 0 0 0 19 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3086155848 134675824 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=28708 CPUtime=0.01
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 1129 0 0 0 0 1 0 0 19 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3086090312 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=28708 CPUtime=0.05
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 1959 0 0 0 5 0 0 0 20 0 5 0 1117463144 29396992 4280 4294967295 134512640 135180984 3216111216 3086024992 134513615 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 28708

[startup+0.309964 s]
/proc/loadavg: 6.91 6.76 6.51 8/113 27022
/proc/meminfo: memFree=2005648/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=40688 CPUtime=0.35
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 7638 0 0 0 30 5 0 0 18 0 5 0 1117463144 41664512 7595 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 10172 7595 63 164 0 10007 0
[pid=27022/tid=27023] ppid=27020 vsize=40688 CPUtime=0
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1117463144 41664512 7595 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=40688 CPUtime=0.12
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 2529 0 0 0 11 1 0 0 20 0 5 0 1117463144 41664512 7596 4294967295 134512640 135180984 3216111216 3086156056 134513812 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=40688 CPUtime=0.11
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 2445 0 0 0 8 3 0 0 19 0 5 0 1117463144 41664512 7596 4294967295 134512640 135180984 3216111216 3086090528 134513802 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=40688 CPUtime=0.12
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 2548 0 0 0 11 1 0 0 21 0 5 0 1117463144 41664512 7596 4294967295 134512640 135180984 3216111216 3086024676 134675767 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.35
Current children cumulated vsize (KiB) 40688

[startup+0.709936 s]
/proc/loadavg: 6.91 6.76 6.51 8/113 27022
/proc/meminfo: memFree=2005648/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=36868 CPUtime=0.95
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 9038 0 0 0 88 7 0 0 18 0 5 0 1117463144 37752832 6880 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 9217 6880 68 164 0 9052 0
[pid=27022/tid=27023] ppid=27020 vsize=36868 CPUtime=0.03
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 598 0 0 0 2 1 0 0 16 0 5 0 1117463144 37752832 6880 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=36868 CPUtime=0.32
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 2769 0 0 0 31 1 0 0 20 0 5 0 1117463144 37752832 6880 4294967295 134512640 135180984 3216111216 3086155648 134518670 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=36868 CPUtime=0.31
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 2779 0 0 0 27 4 0 0 19 0 5 0 1117463144 37752832 6880 4294967295 134512640 135180984 3216111216 3086090096 134528674 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=36868 CPUtime=0.29
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 2782 0 0 0 28 1 0 0 21 0 5 0 1117463144 37752832 6880 4294967295 134512640 135180984 3216111216 3086024576 134518855 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.95
Current children cumulated vsize (KiB) 36868

[startup+1.50987 s]
/proc/loadavg: 6.91 6.76 6.51 8/118 27027
/proc/meminfo: memFree=1977972/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=38024 CPUtime=2.18
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 9270 0 0 0 204 14 0 0 18 0 5 0 1117463144 38936576 7112 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 9506 7112 68 164 0 9341 0
[pid=27022/tid=27023] ppid=27020 vsize=38024 CPUtime=0.1
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 615 0 0 0 4 6 0 0 16 0 5 0 1117463144 38936576 7112 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=38024 CPUtime=0.72
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 2830 0 0 0 71 1 0 0 20 0 5 0 1117463144 38936576 7112 4294967295 134512640 135180984 3216111216 3086155568 134556427 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=38024 CPUtime=0.71
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 2852 0 0 0 66 5 0 0 20 0 5 0 1117463144 38936576 7112 4294967295 134512640 135180984 3216111216 3086090032 134523650 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=38024 CPUtime=0.65
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 2863 0 0 0 63 2 0 0 22 0 5 0 1117463144 38936576 7112 4294967295 134512640 135180984 3216111216 3086024556 134520661 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.18
Current children cumulated vsize (KiB) 38024

[startup+3.10975 s]
/proc/loadavg: 6.91 6.76 6.51 8/118 27027
/proc/meminfo: memFree=1977616/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=39576 CPUtime=4.51
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 9675 0 0 0 428 23 0 0 18 0 5 0 1117463144 40525824 7517 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 9894 7517 68 164 0 9729 0
[pid=27022/tid=27023] ppid=27020 vsize=39576 CPUtime=0.15
/proc/27022/task/27023/stat : 27023 (satake) R 27020 27022 20665 0 -1 4202560 645 0 0 0 6 9 0 0 15 0 5 0 1117463144 40525824 7517 4294967295 134512640 135180984 3216111216 3086221340 134706407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=39576 CPUtime=1.51
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 2966 0 0 0 148 3 0 0 21 0 5 0 1117463144 40525824 7517 4294967295 134512640 135180984 3216111216 3086155632 134528470 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=39576 CPUtime=1.48
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 2995 0 0 0 140 8 0 0 20 0 5 0 1117463144 40525824 7517 4294967295 134512640 135180984 3216111216 3086090160 134532417 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=39576 CPUtime=1.37
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 2959 0 0 0 134 3 0 0 25 0 5 0 1117463144 40525824 7517 4294967295 134512640 135180984 3216111216 3086024356 134580588 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.51
Current children cumulated vsize (KiB) 39576

[startup+6.30949 s]
/proc/loadavg: 7.00 6.78 6.52 8/118 27028
/proc/meminfo: memFree=1973620/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=41788 CPUtime=8.65
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 10452 0 0 0 821 44 0 0 18 0 5 0 1117463144 42790912 8294 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 10447 8294 68 164 0 10282 0
[pid=27022/tid=27023] ppid=27020 vsize=41788 CPUtime=0.29
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 707 0 0 0 10 19 0 0 16 0 5 0 1117463144 42790912 8294 4294967295 134512640 135180984 3216111216 3086221332 134580588 0 0 0 0 3223036975 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=41788 CPUtime=2.73
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 3233 0 0 0 268 5 0 0 25 0 5 0 1117463144 42790912 8294 4294967295 134512640 135180984 3216111216 3086155436 134706407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=41788 CPUtime=2.85
/proc/27022/task/27025/stat : 27025 (satake) S 27020 27022 20665 0 -1 4202560 3241 0 0 0 272 13 0 0 20 0 5 0 1117463144 42790912 8294 4294967295 134512640 135180984 3216111216 3086089888 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=41788 CPUtime=2.78
/proc/27022/task/27026/stat : 27026 (satake) S 27020 27022 20665 0 -1 4202560 3161 0 0 0 271 7 0 0 22 0 5 0 1117463144 42790912 8294 4294967295 134512640 135180984 3216111216 3086024352 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 8.65
Current children cumulated vsize (KiB) 41788

[startup+12.709 s]
/proc/loadavg: 6.92 6.77 6.52 6/118 27029
/proc/meminfo: memFree=1972196/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=42944 CPUtime=9.81
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 10606 0 0 0 936 45 0 0 18 0 5 0 1117463144 43974656 8448 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 10736 8448 68 164 0 10571 0
[pid=27022/tid=27023] ppid=27020 vsize=42944 CPUtime=0.29
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 719 0 0 0 10 19 0 0 16 0 5 0 1117463144 43974656 8448 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=42944 CPUtime=2.86
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 3261 0 0 0 281 5 0 0 25 0 5 0 1117463144 43974656 8448 4294967295 134512640 135180984 3216111216 3086155424 134580407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=42944 CPUtime=3.37
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 3325 0 0 0 324 13 0 0 18 0 5 0 1117463144 43974656 8448 4294967295 134512640 135180984 3216111216 3086090096 134528576 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=42944 CPUtime=3.29
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 3191 0 0 0 321 8 0 0 18 0 5 0 1117463144 43974656 8448 4294967295 134512640 135180984 3216111216 3086024560 134528549 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 9.81
Current children cumulated vsize (KiB) 42944
heavy processes:
  %CPU=95 pid=12341 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=97 pid=12739 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=95 pid=13124 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R
  %CPU=95 pid=13512 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R

[startup+25.508 s]
/proc/loadavg: 6.88 6.76 6.52 8/118 27214
/proc/meminfo: memFree=1965456/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=48636 CPUtime=20.37
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 12146 0 0 0 1970 67 0 0 18 0 5 0 1117463144 49803264 9988 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 12159 9988 68 164 0 11994 0
[pid=27022/tid=27023] ppid=27020 vsize=48636 CPUtime=0.42
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 799 0 0 0 12 30 0 0 15 0 5 0 1117463144 49803264 9988 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=48636 CPUtime=5.39
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 3676 0 0 0 533 6 0 0 25 0 5 0 1117463144 49803264 9988 4294967295 134512640 135180984 3216111216 3086155632 134528267 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=48636 CPUtime=7.41
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 3954 0 0 0 720 21 0 0 20 0 5 0 1117463144 49803264 9988 4294967295 134512640 135180984 3216111216 3086090032 134523644 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=48636 CPUtime=7.15
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 3607 0 0 0 705 10 0 0 21 0 5 0 1117463144 49803264 9988 4294967295 134512640 135180984 3216111216 3086024560 134528470 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 20.37
Current children cumulated vsize (KiB) 48636
heavy processes:
  %CPU=95 pid=12341 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=97 pid=12739 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/Isolet/isoletTrain.arff /users/tao/kegl/Research/Sam
  %CPU=94 pid=13124 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R
  %CPU=95 pid=13512 uid=2256 cmd=./multiboost --fileformat arff --traintest /users/tao/kegl/Research/Samples/LetterRecognition/letterTrain.arff /users/tao/kegl/R

[startup+51.106 s]
/proc/loadavg: 6.64 6.72 6.51 6/118 27215
/proc/meminfo: memFree=1959432/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=53852 CPUtime=29.94
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 13351 0 0 0 2915 79 0 0 18 0 5 0 1117463144 55144448 11193 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 13463 11193 68 164 0 13298 0
[pid=27022/tid=27023] ppid=27020 vsize=53852 CPUtime=0.57
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 846 0 0 0 19 38 0 0 15 0 5 0 1117463144 55144448 11193 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=53852 CPUtime=9.19

################
# More data... #
################

[pid=27022/tid=27024] ppid=27020 vsize=174680 CPUtime=151.65
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 13902 0 0 0 15110 55 0 0 18 0 5 0 1117463144 178872320 41112 4294967295 134512640 135180984 3216111216 3086155632 134528441 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=174680 CPUtime=140.58
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 12147 0 0 0 13998 60 0 0 23 0 5 0 1117463144 178872320 41112 4294967295 134512640 135180984 3216111216 3086090096 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=174680 CPUtime=155.84
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 15284 0 0 0 15532 52 0 0 17 0 5 0 1117463144 178872320 41112 4294967295 134512640 135180984 3216111216 3086024560 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 450.27
Current children cumulated vsize (KiB) 174680

[startup+582.314 s]
/proc/loadavg: 6.80 6.76 6.56 9/118 28910
/proc/meminfo: memFree=1809460/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=189544 CPUtime=525.87
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 46975 0 0 0 52258 329 0 0 18 0 5 0 1117463144 194093056 44817 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 47386 44817 68 164 0 47221 0
[pid=27022/tid=27023] ppid=27020 vsize=189544 CPUtime=2.35
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 1908 0 0 0 87 148 0 0 15 0 5 0 1117463144 194093056 44817 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=189544 CPUtime=183.12
/proc/27022/task/27024/stat : 27024 (satake) S 27020 27022 20665 0 -1 4202560 15503 0 0 0 18253 59 0 0 16 0 5 0 1117463144 194093056 44817 4294967295 134512640 135180984 3216111216 3086155424 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=189544 CPUtime=154.09
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 12919 0 0 0 15346 63 0 0 20 0 5 0 1117463144 194093056 44817 4294967295 134512640 135180984 3216111216 3086090088 134518214 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=189544 CPUtime=186.31
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 16535 0 0 0 18572 59 0 0 25 0 5 0 1117463144 194093056 44817 4294967295 134512640 135180984 3216111216 3086024364 134706407 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 525.87
Current children cumulated vsize (KiB) 189544

[startup+642.31 s]
/proc/loadavg: 6.37 6.65 6.54 6/118 29098
/proc/meminfo: memFree=1794860/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=202864 CPUtime=591.91
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 50152 0 0 0 58841 350 0 0 18 0 5 0 1117463144 207732736 47994 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 50716 47994 68 164 0 50551 0
[pid=27022/tid=27023] ppid=27020 vsize=202864 CPUtime=2.51
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 1986 0 0 0 98 153 0 0 15 0 5 0 1117463144 207732736 47994 4294967295 134512640 135180984 3216111216 3086221332 134580588 0 0 0 0 3223036975 0 0 -1 0 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=202864 CPUtime=210.62
/proc/27022/task/27024/stat : 27024 (satake) S 27020 27022 20665 0 -1 4202560 16707 0 0 0 21000 62 0 0 19 0 5 0 1117463144 207732736 47994 4294967295 134512640 135180984 3216111216 3086155424 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=202864 CPUtime=170.71
/proc/27022/task/27025/stat : 27025 (satake) S 27020 27022 20665 0 -1 4202560 14089 0 0 0 17002 69 0 0 16 0 5 0 1117463144 207732736 47994 4294967295 134512640 135180984 3216111216 3086089888 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=202864 CPUtime=208.07
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 17260 0 0 0 20741 66 0 0 25 0 5 0 1117463144 207732736 47994 4294967295 134512640 135180984 3216111216 3086024364 134706407 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 591.91
Current children cumulated vsize (KiB) 202864

[startup+702.305 s]
/proc/loadavg: 6.63 6.64 6.54 9/118 29287
/proc/meminfo: memFree=1786180/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=211388 CPUtime=642.27
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 51974 0 0 0 63865 362 0 0 18 0 5 0 1117463144 216461312 49816 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 52847 49816 68 164 0 52682 0
[pid=27022/tid=27023] ppid=27020 vsize=211388 CPUtime=2.57
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 2040 0 0 0 99 158 0 0 15 0 5 0 1117463144 216461312 49816 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=211388 CPUtime=229.91
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 17279 0 0 0 22926 65 0 0 25 0 5 0 1117463144 216461312 49816 4294967295 134512640 135180984 3216111216 3086155632 134528661 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=211388 CPUtime=184.01
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 14717 0 0 0 18330 71 0 0 25 0 5 0 1117463144 216461312 49816 4294967295 134512640 135180984 3216111216 3086090048 134522959 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=211388 CPUtime=225.78
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 17828 0 0 0 22510 68 0 0 25 0 5 0 1117463144 216461312 49816 4294967295 134512640 135180984 3216111216 3086024552 134520667 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 642.27
Current children cumulated vsize (KiB) 211388

[startup+762.31 s]
/proc/loadavg: 6.99 6.75 6.58 8/118 29478
/proc/meminfo: memFree=1775012/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=220696 CPUtime=716.63
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 54333 0 0 0 71298 365 0 0 18 0 5 0 1117463144 225992704 52175 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 55174 52175 68 164 0 55009 0
[pid=27022/tid=27023] ppid=27020 vsize=220696 CPUtime=2.6
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 2074 0 0 0 102 158 0 0 15 0 5 0 1117463144 225992704 52175 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=220696 CPUtime=255.81
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 17924 0 0 0 25516 65 0 0 25 0 5 0 1117463144 225992704 52175 4294967295 134512640 135180984 3216111216 3086155632 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=220696 CPUtime=207.61
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 15777 0 0 0 20688 73 0 0 25 0 5 0 1117463144 225992704 52175 4294967295 134512640 135180984 3216111216 3086090096 134528641 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=220696 CPUtime=250.61
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 18448 0 0 0 24992 69 0 0 25 0 5 0 1117463144 225992704 52175 4294967295 134512640 135180984 3216111216 3086024560 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 716.63
Current children cumulated vsize (KiB) 220696

[startup+822.316 s]
/proc/loadavg: 7.28 6.87 6.63 8/118 29665
/proc/meminfo: memFree=1763976/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=230112 CPUtime=794.52
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 56625 0 0 0 79083 369 0 0 18 0 5 0 1117463144 235634688 54467 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 57528 54467 68 164 0 57363 0
[pid=27022/tid=27023] ppid=27020 vsize=230112 CPUtime=2.63
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 2122 0 0 0 104 159 0 0 15 0 5 0 1117463144 235634688 54467 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=230112 CPUtime=280.5
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 18497 0 0 0 27985 65 0 0 25 0 5 0 1117463144 235634688 54467 4294967295 134512640 135180984 3216111216 3086155436 134706407 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=230112 CPUtime=234.19
/proc/27022/task/27025/stat : 27025 (satake) S 27020 27022 20665 0 -1 4202560 16833 0 0 0 23345 74 0 0 25 0 5 0 1117463144 235634688 54467 4294967295 134512640 135180984 3216111216 3086089888 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=230112 CPUtime=277.2
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 19063 0 0 0 27649 71 0 0 25 0 5 0 1117463144 235634688 54467 4294967295 134512640 135180984 3216111216 3086024448 134522961 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 794.52
Current children cumulated vsize (KiB) 230112

[startup+882.311 s]
/proc/loadavg: 7.45 6.96 6.67 9/118 29853
/proc/meminfo: memFree=1754056/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=238740 CPUtime=870.33
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 58690 0 0 0 86653 380 0 0 18 0 5 0 1117463144 244469760 56532 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 59685 56532 68 164 0 59520 0
[pid=27022/tid=27023] ppid=27020 vsize=238740 CPUtime=2.66
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 2171 0 0 0 105 161 0 0 15 0 5 0 1117463144 244469760 56532 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=238740 CPUtime=304.81
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 19075 0 0 0 30413 68 0 0 25 0 5 0 1117463144 244469760 56532 4294967295 134512640 135180984 3216111216 3086155632 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=238740 CPUtime=260.11
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 17622 0 0 0 25933 78 0 0 25 0 5 0 1117463144 244469760 56532 4294967295 134512640 135180984 3216111216 3086090096 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=238740 CPUtime=302.75
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 19712 0 0 0 30202 73 0 0 25 0 5 0 1117463144 244469760 56532 4294967295 134512640 135180984 3216111216 3086024560 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 870.33
Current children cumulated vsize (KiB) 238740

[startup+942.316 s]
/proc/loadavg: 7.32 7.00 6.70 8/118 30041
/proc/meminfo: memFree=1745020/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=246180 CPUtime=947.87
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 60663 0 0 0 94401 386 0 0 18 0 5 0 1117463144 252088320 58505 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 61545 58505 68 164 0 61380 0
[pid=27022/tid=27023] ppid=27020 vsize=246180 CPUtime=2.71
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 2237 0 0 0 106 165 0 0 15 0 5 0 1117463144 252088320 58505 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=246180 CPUtime=328.77
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 19564 0 0 0 32809 68 0 0 25 0 5 0 1117463144 252088320 58505 4294967295 134512640 135180984 3216111216 3086155632 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=246180 CPUtime=287.14
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 18466 0 0 0 28634 80 0 0 25 0 5 0 1117463144 252088320 58505 4294967295 134512640 135180984 3216111216 3086090096 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=246180 CPUtime=329.25
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 20286 0 0 0 32852 73 0 0 25 0 5 0 1117463144 252088320 58505 4294967295 134512640 135180984 3216111216 3086024560 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 947.87
Current children cumulated vsize (KiB) 246180



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 7.34 7.07 6.74 8/118 30230
/proc/meminfo: memFree=1738424/3368532 swapFree=1952996/1959888
[pid=27022] ppid=27020 vsize=252192 CPUtime=1022.64
/proc/27022/stat : 27022 (satake) S 27020 27022 20665 0 -1 4202496 61960 0 0 0 101865 399 0 0 18 0 5 0 1117463144 258244608 59802 4294967295 134512640 135180984 3216111216 3216110652 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/27022/statm: 63048 59802 68 164 0 62883 0
[pid=27022/tid=27023] ppid=27020 vsize=252192 CPUtime=2.79
/proc/27022/task/27023/stat : 27023 (satake) S 27020 27022 20665 0 -1 4202560 2247 0 0 0 108 171 0 0 15 0 5 0 1117463144 258244608 59802 4294967295 134512640 135180984 3216111216 3086221328 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=27022/tid=27024] ppid=27020 vsize=252192 CPUtime=352.88
/proc/27022/task/27024/stat : 27024 (satake) R 27020 27022 20665 0 -1 4202560 20028 0 0 0 35219 69 0 0 25 0 5 0 1117463144 258244608 59802 4294967295 134512640 135180984 3216111216 3086155632 134528636 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27022/tid=27025] ppid=27020 vsize=252192 CPUtime=312.61
/proc/27022/task/27025/stat : 27025 (satake) R 27020 27022 20665 0 -1 4202560 19118 0 0 0 31176 85 0 0 25 0 5 0 1117463144 258244608 59802 4294967295 134512640 135180984 3216111216 3086090092 134523599 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27022/tid=27026] ppid=27020 vsize=252192 CPUtime=354.36
/proc/27022/task/27026/stat : 27026 (satake) R 27020 27022 20665 0 -1 4202560 20457 0 0 0 35362 74 0 0 24 0 5 0 1117463144 258244608 59802 4294967295 134512640 135180984 3216111216 3086024496 134523809 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1022.64
Current children cumulated vsize (KiB) 252192

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.05
CPU time (s): 1022.69
CPU user time (s): 1018.69
CPU system time (s): 4
CPU usage (%): 102.264
Max. virtual memory (cumulated for all children) (KiB): 252192

deleting IPC queue 1048576
deleting IPC queue 1081345
deleting IPC queue 1114114
deleting IPC queue 1146883
deleting IPC queue 1179652
deleting IPC queue 1212421
deleting IPC queue 1245190
deleting IPC queue 1277959
deleting IPC queue 1310728
deleting IPC queue 1343497
deleting IPC queue 1376266
deleting IPC queue 1409035
deleting IPC queue 1441804
deleting IPC queue 1474573
deleting IPC queue 1507342
deleting IPC queue 1540111

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1018.69
system time used= 4
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 61960
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 522770
involuntary context switches= 470875

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi45 at 2009-05-29 23:40:58
IDJOB=1775845
IDBENCH=20390
IDSOLVER=629
FILE ID=tipi45/1775845-1243633258
PBS_JOBID=
Free space on /tmp= 15499 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT07/industrial/fuhs/medium/AProVE07-09.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1775845-1243633258/watcher-1775845-1243633258 -o /tmp/evaluation-result-1775845-1243633258/solver-1775845-1243633258 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1775845-1243633258.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 50ed98553825ac1825482c1496260592
RANDOM SEED= 1484654446

Linux tipi45 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.081
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2005648 kB
Buffers:        147140 kB
Cached:         832420 kB
SwapCached:       2100 kB
Active:        1141612 kB
Inactive:       122680 kB
HighTotal:     2489216 kB
HighFree:      1368856 kB
LowTotal:       879316 kB
LowFree:        636792 kB
SwapTotal:     1959888 kB
SwapFree:      1952996 kB
Dirty:            4648 kB
Writeback:           0 kB
AnonPages:      283812 kB
Mapped:           6384 kB
Slab:            85236 kB
SReclaimable:    73772 kB
SUnreclaim:      11464 kB
PageTables:        964 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   371768 kB
VmallocTotal:   114680 kB
VmallocUsed:     17900 kB
VmallocChunk:    96244 kB

Free space on /tmp at the end= 15499 MiB
End job on tipi45 at 2009-05-29 23:57:41