Trace number 1778950

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 1774.9 1000.04

General information on the benchmark

NameAPPLICATIONS/bitverif/
mulhs/mulhs016.cnf
MD5SUMe4ef55733955e0a45519e9f7dec923e5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4656
Number of clauses13871
Sum of the clauses size32363
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 29246
Number of clauses of size 34623
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1778950-1243640908/watcher-1778950-1243640908 -o /tmp/evaluation-result-1778950-1243640908/solver-1778950-1243640908 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1778950-1243640908.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 5.06 5.32 5.32 7/120 29499
/proc/meminfo: memFree=3110716/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=1092 CPUtime=0
/proc/29496/stat : 29496 (satake) R 29494 29496 17312 0 -1 4202496 110 0 0 0 0 0 0 0 21 0 4 0 1128753628 1118208 66 4294967295 134512640 135180984 3215156624 3215155968 134705812 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 273 66 54 164 0 108 0
[pid=29496/tid=29497] ppid=29494 vsize=1092 CPUtime=0
/proc/29496/task/29497/stat : 29497 (satake) R 29494 29496 17312 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 1128753628 1118208 66 4294967295 134512640 135180984 3215156624 3086189380 134705812 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=1092 CPUtime=0
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 1128753628 1118208 66 4294967295 134512640 135180984 3215156624 3086123844 134705812 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=1092 CPUtime=0
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 1128753628 1118208 66 4294967295 134512640 135180984 3215156624 3086058308 134705812 0 0 0 0 0 0 0 -1 2 0 0 0

[startup+0.085823 s]
/proc/loadavg: 5.06 5.32 5.32 7/120 29499
/proc/meminfo: memFree=3110716/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=6140 CPUtime=0.13
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 1171 0 0 0 13 0 0 0 21 0 5 0 1128753628 6287360 976 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 1535 976 68 164 0 1370 0
[pid=29496/tid=29497] ppid=29494 vsize=6140 CPUtime=0
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 87 0 0 0 0 0 0 0 22 0 5 0 1128753628 6287360 976 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=6140 CPUtime=0.04
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 312 0 0 0 4 0 0 0 23 0 5 0 1128753628 6287360 976 4294967295 134512640 135180984 3215156624 3086122656 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=6140 CPUtime=0.05
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 326 0 0 0 5 0 0 0 22 0 5 0 1128753628 6287360 976 4294967295 134512640 135180984 3215156624 3086057392 134532445 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 6140

[startup+0.11582 s]
/proc/loadavg: 5.06 5.32 5.32 7/120 29499
/proc/meminfo: memFree=3110716/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=6272 CPUtime=0.17
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 1187 0 0 0 17 0 0 0 21 0 5 0 1128753628 6422528 992 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 1568 992 68 164 0 1403 0
[pid=29496/tid=29497] ppid=29494 vsize=6272 CPUtime=0
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 87 0 0 0 0 0 0 0 22 0 5 0 1128753628 6422528 992 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=6272 CPUtime=0.07
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 322 0 0 0 7 0 0 0 23 0 5 0 1128753628 6422528 992 4294967295 134512640 135180984 3215156624 3086122864 134526482 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=6272 CPUtime=0.06
/proc/29496/task/29499/stat : 29499 (satake) S 29494 29496 17312 0 -1 4202560 331 0 0 0 6 0 0 0 22 0 5 0 1128753628 6422528 992 4294967295 134512640 135180984 3215156624 3086057120 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 6272

[startup+0.315822 s]
/proc/loadavg: 5.06 5.32 5.32 7/120 29499
/proc/meminfo: memFree=3110716/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=6668 CPUtime=0.56
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 1294 0 0 0 51 5 0 0 21 0 5 0 1128753628 6828032 1099 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 1667 1099 68 164 0 1502 0
[pid=29496/tid=29497] ppid=29494 vsize=6668 CPUtime=0.04
/proc/29496/task/29497/stat : 29497 (satake) R 29494 29496 17312 0 -1 4202560 93 0 0 0 3 1 0 0 20 0 5 0 1128753628 6828032 1099 4294967295 134512640 135180984 3215156624 3086188572 134706407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=6668 CPUtime=0.22
/proc/29496/task/29498/stat : 29498 (satake) S 29494 29496 17312 0 -1 4202560 363 0 0 0 20 2 0 0 23 0 5 0 1128753628 6828032 1099 4294967295 134512640 135180984 3215156624 3086122656 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=6668 CPUtime=0.23
/proc/29496/task/29499/stat : 29499 (satake) S 29494 29496 17312 0 -1 4202560 383 0 0 0 22 1 0 0 23 0 5 0 1128753628 6828032 1099 4294967295 134512640 135180984 3215156624 3086057120 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.56
Current children cumulated vsize (KiB) 6668

[startup+0.715789 s]
/proc/loadavg: 5.06 5.32 5.32 7/120 29499
/proc/meminfo: memFree=3110716/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=7340 CPUtime=1.33
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 1513 0 0 0 122 11 0 0 21 0 5 0 1128753628 7516160 1318 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 1835 1318 68 164 0 1670 0
[pid=29496/tid=29497] ppid=29494 vsize=7340 CPUtime=0.06
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 118 0 0 0 4 2 0 0 16 0 5 0 1128753628 7516160 1318 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=7340 CPUtime=0.54
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 450 0 0 0 50 4 0 0 25 0 5 0 1128753628 7516160 1318 4294967295 134512640 135180984 3215156624 3086122864 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=7340 CPUtime=0.57
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 449 0 0 0 55 2 0 0 24 0 5 0 1128753628 7516160 1318 4294967295 134512640 135180984 3215156624 3086057328 134526438 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 7340

[startup+1.51575 s]
/proc/loadavg: 5.06 5.32 5.32 6/122 29501
/proc/meminfo: memFree=3105684/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=8396 CPUtime=2.58
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 1854 0 0 0 244 14 0 0 21 0 5 0 1128753628 8597504 1659 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 2099 1659 68 164 0 1934 0
[pid=29496/tid=29497] ppid=29494 vsize=8396 CPUtime=0.08
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 155 0 0 0 4 4 0 0 15 0 5 0 1128753628 8597504 1659 4294967295 134512640 135180984 3215156624 3086188564 134580588 0 0 0 0 3223036975 0 0 -1 1 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=8396 CPUtime=0.89
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 531 0 0 0 84 5 0 0 25 0 5 0 1128753628 8597504 1659 4294967295 134512640 135180984 3215156624 3086122792 134518224 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=8396 CPUtime=1
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 539 0 0 0 98 2 0 0 25 0 5 0 1128753628 8597504 1659 4294967295 134512640 135180984 3215156624 3086057120 134580407 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=8396 CPUtime=0.61
/proc/29496/task/29501/stat : 29501 (satake) S 29494 29496 17312 0 -1 4202560 518 0 0 0 58 3 0 0 25 0 5 0 1128753629 8597504 1659 4294967295 134512640 135180984 3215156624 3085586080 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.58
Current children cumulated vsize (KiB) 8396

[startup+3.11567 s]
/proc/loadavg: 5.06 5.32 5.32 6/124 29503
/proc/meminfo: memFree=3103600/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=11532 CPUtime=5.32
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 2512 0 0 0 511 21 0 0 21 0 5 0 1128753628 11808768 2317 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 2883 2317 68 164 0 2718 0
[pid=29496/tid=29497] ppid=29494 vsize=11532 CPUtime=0.17
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 217 0 0 0 10 7 0 0 15 0 5 0 1128753628 11808768 2317 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=11532 CPUtime=1.63
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 689 0 0 0 157 6 0 0 25 0 5 0 1128753628 11808768 2317 4294967295 134512640 135180984 3215156624 3086122924 134518208 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=11532 CPUtime=1.88
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 733 0 0 0 184 4 0 0 25 0 5 0 1128753628 11808768 2317 4294967295 134512640 135180984 3215156624 3086057120 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=11532 CPUtime=1.64
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 762 0 0 0 160 4 0 0 25 0 5 0 1128753629 11808768 2317 4294967295 134512640 135180984 3215156624 3085586284 134519884 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.32
Current children cumulated vsize (KiB) 11532

[startup+6.3155 s]
/proc/loadavg: 5.05 5.32 5.31 5/122 29510
/proc/meminfo: memFree=3099412/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=13360 CPUtime=10.72
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 3103 0 0 0 1034 38 0 0 21 0 5 0 1128753628 13680640 2908 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 3340 2908 68 164 0 3175 0
[pid=29496/tid=29497] ppid=29494 vsize=13360 CPUtime=0.31
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 272 0 0 0 13 18 0 0 15 0 5 0 1128753628 13680640 2908 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=13360 CPUtime=3.36
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 870 0 0 0 328 8 0 0 25 0 5 0 1128753628 13680640 2908 4294967295 134512640 135180984 3215156624 3086122856 134518255 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=13360 CPUtime=3.79
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 885 0 0 0 373 6 0 0 25 0 5 0 1128753628 13680640 2908 4294967295 134512640 135180984 3215156624 3086057328 134528441 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=13360 CPUtime=3.26
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 965 0 0 0 320 6 0 0 25 0 5 0 1128753629 13680640 2908 4294967295 134512640 135180984 3215156624 3085586080 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 10.72
Current children cumulated vsize (KiB) 13360

[startup+12.7152 s]
/proc/loadavg: 5.05 5.31 5.31 6/122 29519
/proc/meminfo: memFree=3095652/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=16632 CPUtime=21.63
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 3848 0 0 0 2120 43 0 0 21 0 5 0 1128753628 17031168 3653 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 4158 3653 68 164 0 3993 0
[pid=29496/tid=29497] ppid=29494 vsize=16632 CPUtime=0.36
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 342 0 0 0 16 20 0 0 16 0 5 0 1128753628 17031168 3653 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=16632 CPUtime=6.66
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 1081 0 0 0 657 9 0 0 25 0 5 0 1128753628 17031168 3653 4294967295 134512640 135180984 3215156624 3086122656 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=16632 CPUtime=7.77
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 1119 0 0 0 770 7 0 0 25 0 5 0 1128753628 17031168 3653 4294967295 134512640 135180984 3215156624 3086057328 134528406 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=16632 CPUtime=6.84
/proc/29496/task/29501/stat : 29501 (satake) S 29494 29496 17312 0 -1 4202560 1195 0 0 0 677 7 0 0 25 0 5 0 1128753629 17031168 3653 4294967295 134512640 135180984 3215156624 3085586080 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 21.63
Current children cumulated vsize (KiB) 16632

[startup+25.5145 s]
/proc/loadavg: 5.04 5.30 5.31 6/122 29540
/proc/meminfo: memFree=3094104/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=18976 CPUtime=42.63
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 4421 0 0 0 4191 72 0 0 21 0 5 0 1128753628 19431424 4226 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 4744 4226 68 164 0 4579 0
[pid=29496/tid=29497] ppid=29494 vsize=18976 CPUtime=0.59
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 415 0 0 0 21 38 0 0 16 0 5 0 1128753628 19431424 4226 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=18976 CPUtime=14.02
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 1211 0 0 0 1391 11 0 0 25 0 5 0 1128753628 19431424 4226 4294967295 134512640 135180984 3215156624 3086122860 134522603 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=18976 CPUtime=13.87
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 1261 0 0 0 1375 12 0 0 25 0 5 0 1128753628 19431424 4226 4294967295 134512640 135180984 3215156624 3086057324 134518218 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=18976 CPUtime=14.15
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 1423 0 0 0 1404 11 0 0 25 0 5 0 1128753629 19431424 4226 4294967295 134512640 135180984 3215156624 3085586080 134580407 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 42.63
Current children cumulated vsize (KiB) 18976

[startup+51.1132 s]
/proc/loadavg: 4.94 5.25 5.29 5/122 29578
/proc/meminfo: memFree=3087936/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=25216 CPUtime=86.57
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 5921 0 0 0 8490 167 0 0 21 0 5 0 1128753628 25821184 5726 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 6304 5726 68 164 0 6139 0
[pid=29496/tid=29497] ppid=29494 vsize=25216 CPUtime=1.4
/proc/29496/task/29497/stat : 29497 (satake) R 29494 29496 17312 0 -1 4202560 593 0 0 0 44 96 0 0 16 0 5 0 1128753628 25821184 5726 4294967295 134512640 135180984 3215156624 3086188564 134580588 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=25216 CPUtime=29.22
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 1460 0 0 0 2899 23 0 0 25 0 5 0 1128753628 25821184 5726 4294967295 134512640 135180984 3215156624 3086122656 134580407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=25216 CPUtime=29.13
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 1634 0 0 0 2884 29 0 0 25 0 5 0 1128753628 25821184 5726 4294967295 134512640 135180984 3215156624 3086057328 134525707 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=25216 CPUtime=26.82
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 2123 0 0 0 2663 19 0 0 25 0 5 0 1128753629 25821184 5726 4294967295 134512640 135180984 3215156624 3085586288 134528403 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 86.57
Current children cumulated vsize (KiB) 25216

[startup+102.31 s]
/proc/loadavg: 4.97 5.21 5.27 6/124 29843
/proc/meminfo: memFree=3081760/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=31212 CPUtime=175.7
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 7453 0 0 0 17299 271 0 0 21 0 5 0 1128753628 31961088 7258 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 7803 7258 68 164 0 7638 0
[pid=29496/tid=29497] ppid=29494 vsize=31212 CPUtime=2.44
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 831 0 0 0 82 162 0 0 16 0 5 0 1128753628 31961088 7258 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=31212 CPUtime=58.94
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 1828 0 0 0 5855 39 0 0 25 0 5 0 1128753628 31961088 7258 4294967295 134512640 135180984 3215156624 3086122856 134518224 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=31212 CPUtime=59.54
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 1955 0 0 0 5914 40 0 0 25 0 5 0 1128753628 31961088 7258 4294967295 134512640 135180984 3215156624 3086057120 134580407 0 0 0 0 0 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=29496/tid=29498] ppid=29494 vsize=64324 CPUtime=308.07
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 3375 0 0 0 30646 161 0 0 25 0 5 0 1128753628 65867776 15066 4294967295 134512640 135180984 3215156624 3086122864 134528209 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=64324 CPUtime=289.53
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 3372 0 0 0 28806 147 0 0 25 0 5 0 1128753628 65867776 15066 4294967295 134512640 135180984 3215156624 3086057120 134580407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=64324 CPUtime=303.75
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 5340 0 0 0 30234 141 0 0 25 0 5 0 1128753629 65867776 15066 4294967295 134512640 135180984 3215156624 3085586288 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 916.97
Current children cumulated vsize (KiB) 64324

[startup+582.315 s]
/proc/loadavg: 4.68 4.87 5.07 6/122 32065
/proc/meminfo: memFree=3044660/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=68500 CPUtime=1020.76
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 16401 0 0 0 100270 1806 0 0 21 0 5 0 1128753628 70144000 16206 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 17125 16206 68 164 0 16960 0
[pid=29496/tid=29497] ppid=29494 vsize=68500 CPUtime=18.32
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 3341 0 0 0 503 1329 0 0 16 0 5 0 1128753628 70144000 16206 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=68500 CPUtime=343.06
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 3691 0 0 0 34133 173 0 0 25 0 5 0 1128753628 70144000 16206 4294967295 134512640 135180984 3215156624 3086122656 134580407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=68500 CPUtime=322.09
/proc/29496/task/29499/stat : 29499 (satake) S 29494 29496 17312 0 -1 4202560 3596 0 0 0 32055 154 0 0 25 0 5 0 1128753628 70144000 16206 4294967295 134512640 135180984 3215156624 3086057120 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=68500 CPUtime=337.29
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 5662 0 0 0 33579 150 0 0 25 0 5 0 1128753629 70144000 16206 4294967295 134512640 135180984 3215156624 3085586192 134524814 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1020.76
Current children cumulated vsize (KiB) 68500

[startup+642.312 s]
/proc/loadavg: 4.83 4.86 5.06 6/122 32342
/proc/meminfo: memFree=3042036/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=71296 CPUtime=1124.47
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 17184 0 0 0 110384 2063 0 0 21 0 5 0 1128753628 73007104 16989 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 17824 16989 68 164 0 17659 0
[pid=29496/tid=29497] ppid=29494 vsize=71296 CPUtime=20.86
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 3695 0 0 0 570 1516 0 0 15 0 5 0 1128753628 73007104 16989 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=71296 CPUtime=374.35
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 3853 0 0 0 37233 202 0 0 25 0 5 0 1128753628 73007104 16989 4294967295 134512640 135180984 3215156624 3086122656 134580407 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=71296 CPUtime=357.56
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 3728 0 0 0 35579 177 0 0 25 0 5 0 1128753628 73007104 16989 4294967295 134512640 135180984 3215156624 3086057328 134528206 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=71296 CPUtime=371.7
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 5797 0 0 0 37002 168 0 0 25 0 5 0 1128753629 73007104 16989 4294967295 134512640 135180984 3215156624 3085586224 134523663 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1124.47
Current children cumulated vsize (KiB) 71296

[startup+702.309 s]
/proc/loadavg: 4.84 4.85 5.04 6/124 32615
/proc/meminfo: memFree=3037748/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=76588 CPUtime=1232.79
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 18393 0 0 0 121072 2207 0 0 21 0 5 0 1128753628 78426112 18198 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 19147 18198 68 164 0 18982 0
[pid=29496/tid=29497] ppid=29494 vsize=76588 CPUtime=22.51
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 3945 0 0 0 623 1628 0 0 15 0 5 0 1128753628 78426112 18198 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=76588 CPUtime=409.82
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 4103 0 0 0 40772 210 0 0 25 0 5 0 1128753628 78426112 18198 4294967295 134512640 135180984 3215156624 3086122668 134706407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=76588 CPUtime=392.61
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 3938 0 0 0 39070 191 0 0 25 0 5 0 1128753628 78426112 18198 4294967295 134512640 135180984 3215156624 3086057328 134526756 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=76588 CPUtime=407.85
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 6296 0 0 0 40607 178 0 0 25 0 5 0 1128753629 78426112 18198 4294967295 134512640 135180984 3215156624 3085586192 134524746 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1232.79
Current children cumulated vsize (KiB) 76588

[startup+762.316 s]
/proc/loadavg: 4.99 4.89 5.04 6/122 425
/proc/meminfo: memFree=3034028/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=79844 CPUtime=1342.62
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 19209 0 0 0 131954 2308 0 0 21 0 5 0 1128753628 81760256 19014 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 19961 19014 68 164 0 19796 0
[pid=29496/tid=29497] ppid=29494 vsize=79844 CPUtime=23.51
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 4059 0 0 0 652 1699 0 0 15 0 5 0 1128753628 81760256 19014 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=79844 CPUtime=445.24
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 4417 0 0 0 44302 222 0 0 25 0 5 0 1128753628 81760256 19014 4294967295 134512640 135180984 3215156624 3086122800 134523762 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=79844 CPUtime=427.96
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 4229 0 0 0 42595 201 0 0 25 0 5 0 1128753628 81760256 19014 4294967295 134512640 135180984 3215156624 3086057324 134518246 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=79844 CPUtime=445.91
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 6393 0 0 0 44405 186 0 0 25 0 5 0 1128753629 81760256 19014 4294967295 134512640 135180984 3215156624 3085586080 134580407 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1342.62
Current children cumulated vsize (KiB) 79844

[startup+822.302 s]
/proc/loadavg: 4.85 4.88 5.02 6/124 698
/proc/meminfo: memFree=3033764/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=81120 CPUtime=1451.53
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 19558 0 0 0 142727 2426 0 0 21 0 5 0 1128753628 83066880 19363 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 20280 19363 68 164 0 20115 0
[pid=29496/tid=29497] ppid=29494 vsize=81120 CPUtime=25.13
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 4168 0 0 0 711 1802 0 0 16 0 5 0 1128753628 83066880 19363 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=81120 CPUtime=480.84
/proc/29496/task/29498/stat : 29498 (satake) S 29494 29496 17312 0 -1 4202560 4496 0 0 0 47858 226 0 0 25 0 5 0 1128753628 83066880 19363 4294967295 134512640 135180984 3215156624 3086122656 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=81120 CPUtime=464.15
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 4233 0 0 0 46207 208 0 0 25 0 5 0 1128753628 83066880 19363 4294967295 134512640 135180984 3215156624 3086057120 134580407 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=81120 CPUtime=481.41
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 6550 0 0 0 47951 190 0 0 25 0 5 0 1128753629 83066880 19363 4294967295 134512640 135180984 3215156624 3085586288 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1451.53
Current children cumulated vsize (KiB) 81120

[startup+882.319 s]
/proc/loadavg: 4.73 4.84 4.99 6/122 984
/proc/meminfo: memFree=3030720/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=84184 CPUtime=1559.43
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 20135 0 0 0 153367 2576 0 0 21 0 5 0 1128753628 86204416 19940 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 21046 19940 68 164 0 20881 0
[pid=29496/tid=29497] ppid=29494 vsize=84184 CPUtime=26.9
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 4342 0 0 0 761 1929 0 0 15 0 5 0 1128753628 86204416 19940 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=84184 CPUtime=510.41
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 4547 0 0 0 50810 231 0 0 25 0 5 0 1128753628 86204416 19940 4294967295 134512640 135180984 3215156624 3086122864 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=84184 CPUtime=502.48
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 4343 0 0 0 50032 216 0 0 25 0 5 0 1128753628 86204416 19940 4294967295 134512640 135180984 3215156624 3086057440 134530765 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=84184 CPUtime=519.64
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 6792 0 0 0 51764 200 0 0 25 0 5 0 1128753629 86204416 19940 4294967295 134512640 135180984 3215156624 3085586288 134528760 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1559.43
Current children cumulated vsize (KiB) 84184

[startup+942.316 s]
/proc/loadavg: 4.83 4.85 4.99 6/124 1267
/proc/meminfo: memFree=3028944/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=85628 CPUtime=1668.91
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 20510 0 0 0 164201 2690 0 0 21 0 5 0 1128753628 87683072 20315 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 21407 20315 68 164 0 21242 0
[pid=29496/tid=29497] ppid=29494 vsize=85628 CPUtime=28.33
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 4437 0 0 0 808 2025 0 0 16 0 5 0 1128753628 87683072 20315 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=85628 CPUtime=540.36
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 4587 0 0 0 53802 234 0 0 25 0 5 0 1128753628 87683072 20315 4294967295 134512640 135180984 3215156624 3086122668 134706407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=85628 CPUtime=540.71
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 4477 0 0 0 53850 221 0 0 25 0 5 0 1128753628 87683072 20315 4294967295 134512640 135180984 3215156624 3086057328 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=85628 CPUtime=559.51
/proc/29496/task/29501/stat : 29501 (satake) S 29494 29496 17312 0 -1 4202560 6898 0 0 0 55741 210 0 0 25 0 5 0 1128753629 87683072 20315 4294967295 134512640 135180984 3215156624 3085586080 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1668.91
Current children cumulated vsize (KiB) 85628



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 4.90 4.87 4.99 6/122 1540
/proc/meminfo: memFree=3028664/3368532 swapFree=1959840/1959888
[pid=29496] ppid=29494 vsize=87200 CPUtime=1774.88
/proc/29496/stat : 29496 (satake) S 29494 29496 17312 0 -1 4202496 20641 0 0 0 174684 2804 0 0 21 0 5 0 1128753628 89292800 20446 4294967295 134512640 135180984 3215156624 3215156060 134573496 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/29496/statm: 21800 20446 68 164 0 21635 0
[pid=29496/tid=29497] ppid=29494 vsize=87200 CPUtime=29.67
/proc/29496/task/29497/stat : 29497 (satake) S 29494 29496 17312 0 -1 4202560 4520 0 0 0 843 2124 0 0 15 0 5 0 1128753628 89292800 20446 4294967295 134512640 135180984 3215156624 3086188560 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=29496/tid=29498] ppid=29494 vsize=87200 CPUtime=570.36
/proc/29496/task/29498/stat : 29498 (satake) R 29494 29496 17312 0 -1 4202560 4599 0 0 0 56799 237 0 0 25 0 5 0 1128753628 89292800 20446 4294967295 134512640 135180984 3215156624 3086122668 134706407 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29496/tid=29499] ppid=29494 vsize=87200 CPUtime=576.03
/proc/29496/task/29499/stat : 29499 (satake) R 29494 29496 17312 0 -1 4202560 4511 0 0 0 57372 231 0 0 25 0 5 0 1128753628 89292800 20446 4294967295 134512640 135180984 3215156624 3086057328 134528470 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=29496/tid=29501] ppid=29494 vsize=87200 CPUtime=598.82
/proc/29496/task/29501/stat : 29501 (satake) R 29494 29496 17312 0 -1 4202560 6900 0 0 0 59670 212 0 0 25 0 5 0 1128753629 89292800 20446 4294967295 134512640 135180984 3215156624 3085586288 134526365 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1774.88
Current children cumulated vsize (KiB) 87200

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.04
CPU time (s): 1774.9
CPU user time (s): 1746.86
CPU system time (s): 28.04
CPU usage (%): 177.483
Max. virtual memory (cumulated for all children) (KiB): 87200

deleting IPC queue 8388608
deleting IPC queue 8421377
deleting IPC queue 8454146
deleting IPC queue 8486915
deleting IPC queue 8519684
deleting IPC queue 8552453
deleting IPC queue 8585222
deleting IPC queue 8617991
deleting IPC queue 8650760
deleting IPC queue 8683529
deleting IPC queue 8716298
deleting IPC queue 8749067
deleting IPC queue 8781836
deleting IPC queue 8814605
deleting IPC queue 8847374
deleting IPC queue 8880143

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1746.86
system time used= 28.04
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20641
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3331301
involuntary context switches= 3135548

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 01:48:28
IDJOB=1778950
IDBENCH=70785
IDSOLVER=629
FILE ID=/1778950-1243640908
PBS_JOBID=
Free space on /tmp= 7985 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bitverif/mulhs/mulhs016.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1778950-1243640908/watcher-1778950-1243640908 -o /tmp/evaluation-result-1778950-1243640908/solver-1778950-1243640908 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1778950-1243640908.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= e4ef55733955e0a45519e9f7dec923e5
RANDOM SEED= 86678805

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3110716 kB
Buffers:         56740 kB
Cached:          93876 kB
SwapCached:          0 kB
Active:          78680 kB
Inactive:        94136 kB
HighTotal:     2489216 kB
HighFree:      2372712 kB
LowTotal:       879316 kB
LowFree:        738004 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            1108 kB
Writeback:           0 kB
AnonPages:       22200 kB
Mapped:           8060 kB
Slab:            74056 kB
SReclaimable:    61660 kB
SUnreclaim:      12396 kB
PageTables:        768 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   123564 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 7985 MiB
End job on  at 2009-05-30 02:05:10