Trace number 1775965

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 2997.81 1000.03

General information on the benchmark

Nameindustrial/palacios/hard/
sortnet-7-ipc5-h15-unsat.cnf
MD5SUM0683489092a5eb0c881dd17c2c45d08e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables105623
Number of clauses374254
Sum of the clauses size911890
Maximum clause length43
Minimum clause length1
Number of clauses of size 1128
Number of clauses of size 2269133
Number of clauses of size 399944
Number of clauses of size 4407
Number of clauses of size 5309
Number of clauses of size over 54333

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1775965-1243633909/watcher-1775965-1243633909 -o /tmp/evaluation-result-1775965-1243633909/solver-1775965-1243633909 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1775965-1243633909.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.76 2.97 2.84 3/99 31534
/proc/meminfo: memFree=3175940/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=5264 CPUtime=0
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 733 0 0 0 0 0 0 0 18 0 5 0 1128055375 5390336 690 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 1316 694 63 164 0 1151 0
[pid=31534/tid=31535] ppid=31532 vsize=5264 CPUtime=0
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128055375 5390336 712 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=5264 CPUtime=0
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 642 0 0 0 0 0 0 0 19 0 5 0 1128055375 5390336 717 4294967295 134512640 135180984 3216881456 3086291236 134583077 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=5264 CPUtime=0
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 5 0 1128055375 5390336 722 4294967295 134512640 135180984 3216881456 3086226244 134705812 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=5264 CPUtime=0
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1128055375 5390336 727 4294967295 134512640 135180984 3216881456 3086160708 134705812 0 0 0 0 0 0 0 -1 3 0 0 0

[startup+0.058183 s]
/proc/loadavg: 2.76 2.97 2.84 3/99 31534
/proc/meminfo: memFree=3175940/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=22284 CPUtime=0.1
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 5217 0 0 0 7 3 0 0 18 0 5 0 1128055375 22818816 5167 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 5571 5167 63 164 0 5406 0
[pid=31534/tid=31535] ppid=31532 vsize=22284 CPUtime=0
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128055375 22818816 5167 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=22284 CPUtime=0.05
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 2347 0 0 0 4 1 0 0 19 0 5 0 1128055375 22818816 5167 4294967295 134512640 135180984 3216881456 3086291172 134681037 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=22284 CPUtime=0.05
/proc/31534/task/31537/stat : 31537 (satake) D 31532 31534 21929 0 -1 4202560 2219 0 0 0 3 2 0 0 19 0 5 0 1128055375 22818816 5167 4294967295 134512640 135180984 3216881456 3086225496 134675846 0 0 0 0 3223098951 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=22284 CPUtime=0
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 533 0 0 0 0 0 0 0 21 0 5 0 1128055375 22818816 5167 4294967295 134512640 135180984 3216881456 3086160180 134706046 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 22284

[startup+0.117751 s]
/proc/loadavg: 2.76 2.97 2.84 3/99 31534
/proc/meminfo: memFree=3175940/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=38676 CPUtime=0.27
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 8721 0 0 0 22 5 0 0 18 0 5 0 1128055375 39604224 8667 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 9669 8668 63 164 0 9504 0
[pid=31534/tid=31535] ppid=31532 vsize=38676 CPUtime=0
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128055375 39604224 8669 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=38676 CPUtime=0.1
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 3189 0 0 0 8 2 0 0 19 0 5 0 1128055375 39604224 8670 4294967295 134512640 135180984 3216881456 3086291216 134520025 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=38676 CPUtime=0.11
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 2977 0 0 0 9 2 0 0 19 0 5 0 1128055375 39604224 8670 4294967295 134512640 135180984 3216881456 3086225664 134519674 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=38676 CPUtime=0.06
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 2440 0 0 0 5 1 0 0 20 0 5 0 1128055375 39604224 8670 4294967295 134512640 135180984 3216881456 3086159944 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 38676

[startup+0.347538 s]
/proc/loadavg: 2.76 2.97 2.84 3/99 31534
/proc/meminfo: memFree=3175940/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=91724 CPUtime=0.93
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 19049 0 0 0 84 9 0 0 18 0 5 0 1128055375 93925376 18995 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 22931 18998 63 164 0 22766 0
[pid=31534/tid=31535] ppid=31532 vsize=91724 CPUtime=0
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128055375 93925376 18999 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=91724 CPUtime=0.32
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 6626 0 0 0 28 4 0 0 17 0 5 0 1128055375 93925376 19000 4294967295 134512640 135180984 3216881456 3086291216 134520025 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=91724 CPUtime=0.33
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 6399 0 0 0 30 3 0 0 18 0 5 0 1128055375 93925376 19001 4294967295 134512640 135180984 3216881456 3086225692 134513807 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=91724 CPUtime=0.29
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 5911 0 0 0 27 2 0 0 19 0 5 0 1128055375 93925376 19001 4294967295 134512640 135180984 3216881456 3086160020 134579745 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.93
Current children cumulated vsize (KiB) 91724

[startup+0.707506 s]
/proc/loadavg: 2.76 2.97 2.84 3/99 31534
/proc/meminfo: memFree=3175940/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=89364 CPUtime=1.98
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 24158 0 0 0 187 11 0 0 18 0 5 0 1128055375 91508736 19369 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 22341 19369 66 164 0 22176 0
[pid=31534/tid=31535] ppid=31532 vsize=89364 CPUtime=0.03
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 1886 0 0 0 2 1 0 0 16 0 5 0 1128055375 91508736 19369 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=89364 CPUtime=0.65
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 7377 0 0 0 61 4 0 0 17 0 5 0 1128055375 91508736 19369 4294967295 134512640 135180984 3216881456 3086290800 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=89364 CPUtime=0.68
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 7173 0 0 0 65 3 0 0 18 0 5 0 1128055375 91508736 19369 4294967295 134512640 135180984 3216881456 3086225264 134528211 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=89364 CPUtime=0.63
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 7611 0 0 0 60 3 0 0 18 0 5 0 1128055375 91508736 19369 4294967295 134512640 135180984 3216881456 3086159720 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.98
Current children cumulated vsize (KiB) 89364

[startup+1.50743 s]
/proc/loadavg: 2.76 2.97 2.84 4/104 31539
/proc/meminfo: memFree=3098884/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=89496 CPUtime=4.38
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 24204 0 0 0 425 13 0 0 18 0 5 0 1128055375 91643904 19415 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 22374 19415 68 164 0 22209 0
[pid=31534/tid=31535] ppid=31532 vsize=89496 CPUtime=0.04
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 1893 0 0 0 2 2 0 0 16 0 5 0 1128055375 91643904 19415 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=89496 CPUtime=1.44
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 7389 0 0 0 139 5 0 0 19 0 5 0 1128055375 91643904 19415 4294967295 134512640 135180984 3216881456 3086290912 134531534 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=89496 CPUtime=1.48
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 7181 0 0 0 145 3 0 0 19 0 5 0 1128055375 91643904 19415 4294967295 134512640 135180984 3216881456 3086225328 134532451 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=89496 CPUtime=1.43
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 7630 0 0 0 140 3 0 0 20 0 5 0 1128055375 91643904 19415 4294967295 134512640 135180984 3216881456 3086159720 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.38
Current children cumulated vsize (KiB) 89496

[startup+3.10728 s]
/proc/loadavg: 2.86 2.99 2.84 4/104 31539
/proc/meminfo: memFree=3098884/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=89628 CPUtime=9.17
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 24323 0 0 0 899 18 0 0 18 0 5 0 1128055375 91779072 19534 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 22407 19534 68 164 0 22242 0
[pid=31534/tid=31535] ppid=31532 vsize=89628 CPUtime=0.07
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 1905 0 0 0 4 3 0 0 16 0 5 0 1128055375 91779072 19534 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=89628 CPUtime=3.01
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 7417 0 0 0 294 7 0 0 22 0 5 0 1128055375 91779072 19534 4294967295 134512640 135180984 3216881456 3086290800 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=89628 CPUtime=3.07
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 7227 0 0 0 303 4 0 0 22 0 5 0 1128055375 91779072 19534 4294967295 134512640 135180984 3216881456 3086225328 134532460 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=89628 CPUtime=3.03
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 7663 0 0 0 299 4 0 0 23 0 5 0 1128055375 91779072 19534 4294967295 134512640 135180984 3216881456 3086159664 134523791 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.17
Current children cumulated vsize (KiB) 89628

[startup+6.30697 s]
/proc/loadavg: 2.86 2.99 2.84 5/104 31539
/proc/meminfo: memFree=3097924/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=91052 CPUtime=18.77
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 24607 0 0 0 1848 29 0 0 18 0 5 0 1128055375 93237248 19818 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 22763 19818 68 164 0 22598 0
[pid=31534/tid=31535] ppid=31532 vsize=91052 CPUtime=0.13
/proc/31534/task/31535/stat : 31535 (satake) D 31532 31534 21929 0 -1 4202560 1932 0 0 0 4 9 0 0 16 0 5 0 1128055375 93237248 19818 4294967295 134512640 135180984 3216881456 3086356508 134706407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=91052 CPUtime=6.15
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 7505 0 0 0 606 9 0 0 25 0 5 0 1128055375 93237248 19818 4294967295 134512640 135180984 3216881456 3086290800 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=91052 CPUtime=6.27
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 7308 0 0 0 622 5 0 0 25 0 5 0 1128055375 93237248 19818 4294967295 134512640 135180984 3216881456 3086225068 134706407 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=91052 CPUtime=6.23
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 7751 0 0 0 616 7 0 0 25 0 5 0 1128055375 93237248 19818 4294967295 134512640 135180984 3216881456 3086159720 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 18.77
Current children cumulated vsize (KiB) 91052

[startup+12.7064 s]
/proc/loadavg: 2.88 2.99 2.84 5/104 31539
/proc/meminfo: memFree=3095724/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=92764 CPUtime=37.96
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 25129 0 0 0 3737 59 0 0 18 0 5 0 1128055375 94990336 20340 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 23191 20340 68 164 0 23026 0
[pid=31534/tid=31535] ppid=31532 vsize=92764 CPUtime=0.33
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 1994 0 0 0 12 21 0 0 15 0 5 0 1128055375 94990336 20340 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=92764 CPUtime=12.35
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 7628 0 0 0 1223 12 0 0 25 0 5 0 1128055375 94990336 20340 4294967295 134512640 135180984 3216881456 3086290632 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=92764 CPUtime=12.66
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 7463 0 0 0 1257 9 0 0 25 0 5 0 1128055375 94990336 20340 4294967295 134512640 135180984 3216881456 3086225264 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=92764 CPUtime=12.63
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 7933 0 0 0 1246 17 0 0 25 0 5 0 1128055375 94990336 20340 4294967295 134512640 135180984 3216881456 3086159788 134518208 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37.96
Current children cumulated vsize (KiB) 92764

[startup+25.5151 s]
/proc/loadavg: 2.90 2.99 2.85 4/104 31539
/proc/meminfo: memFree=3091364/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=97240 CPUtime=76.34
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 26157 0 0 0 7522 112 0 0 18 0 5 0 1128055375 99573760 21368 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 24310 21368 68 164 0 24145 0
[pid=31534/tid=31535] ppid=31532 vsize=97240 CPUtime=0.65
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 2093 0 0 0 17 48 0 0 16 0 5 0 1128055375 99573760 21368 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=97240 CPUtime=25.07
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 7895 0 0 0 2488 19 0 0 25 0 5 0 1128055375 99573760 21368 4294967295 134512640 135180984 3216881456 3086290800 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=97240 CPUtime=25.21
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 7747 0 0 0 2505 16 0 0 25 0 5 0 1128055375 99573760 21368 4294967295 134512640 135180984 3216881456 3086225264 134528760 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=97240 CPUtime=25.42
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 8311 0 0 0 2513 29 0 0 25 0 5 0 1128055375 99573760 21368 4294967295 134512640 135180984 3216881456 3086159728 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 76.34
Current children cumulated vsize (KiB) 97240

[startup+51.1127 s]
/proc/loadavg: 2.93 2.99 2.85 4/104 31724
/proc/meminfo: memFree=3083448/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=104772 CPUtime=153.01
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 28022 0 0 0 15136 165 0 0 18 0 5 0 1128055375 107286528 23233 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 26193 23233 68 164 0 26028 0
[pid=31534/tid=31535] ppid=31532 vsize=104772 CPUtime=0.98
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 2271 0 0 0 30 68 0 0 16 0 5 0 1128055375 107286528 23233 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=104772 CPUtime=50.65
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 8501 0 0 0 5039 26 0 0 25 0 5 0 1128055375 107286528 23233 4294967295 134512640 135180984 3216881456 3086290632 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=104772 CPUtime=50.43
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 8214 0 0 0 5016 27 0 0 25 0 5 0 1128055375 107286528 23233 4294967295 134512640 135180984 3216881456 3086225264 134528211 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=104772 CPUtime=50.96
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 8925 0 0 0 5052 44 0 0 25 0 5 0 1128055375 107286528 23233 4294967295 134512640 135180984 3216881456 3086159720 134518252 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 153.01
Current children cumulated vsize (KiB) 104772

[startup+102.308 s]
/proc/loadavg: 2.97 2.99 2.85 4/104 31915

################
# More data... #
################

[pid=31534/tid=31536] ppid=31532 vsize=223312 CPUtime=521.7
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 16486 0 0 0 52094 76 0 0 25 0 5 0 1128055375 228671488 52824 4294967295 134512640 135180984 3216881456 3086290800 134528211 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=223312 CPUtime=518.42
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 17773 0 0 0 51768 74 0 0 25 0 5 0 1128055375 228671488 52824 4294967295 134512640 135180984 3216881456 3086225264 134528237 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=223312 CPUtime=521.67
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 19686 0 0 0 51992 175 0 0 25 0 5 0 1128055375 228671488 52824 4294967295 134512640 135180984 3216881456 3086159720 134520881 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1565.64
Current children cumulated vsize (KiB) 223312

[startup+582.312 s]
/proc/loadavg: 2.99 2.99 2.90 4/104 964
/proc/meminfo: memFree=2954136/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=233384 CPUtime=1745.61
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 60114 0 0 0 173915 646 0 0 18 0 5 0 1128055375 238985216 55325 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 58346 55325 68 164 0 58181 0
[pid=31534/tid=31535] ppid=31532 vsize=233384 CPUtime=4.11
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 3705 0 0 0 114 297 0 0 15 0 5 0 1128055375 238985216 55325 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=233384 CPUtime=581.7
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 17214 0 0 0 58085 85 0 0 25 0 5 0 1128055375 238985216 55325 4294967295 134512640 135180984 3216881456 3086290792 134520863 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=233384 CPUtime=578.15
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 18584 0 0 0 57737 78 0 0 25 0 5 0 1128055375 238985216 55325 4294967295 134512640 135180984 3216881456 3086225256 134520863 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=233384 CPUtime=581.66
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 20500 0 0 0 57980 186 0 0 25 0 5 0 1128055375 238985216 55325 4294967295 134512640 135180984 3216881456 3086159728 134528211 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1745.61
Current children cumulated vsize (KiB) 233384

[startup+642.306 s]
/proc/loadavg: 2.99 2.99 2.91 4/104 1156
/proc/meminfo: memFree=2945216/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=241524 CPUtime=1925.42
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 62272 0 0 0 191849 693 0 0 18 0 5 0 1128055375 247320576 57483 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 60381 57483 68 164 0 60216 0
[pid=31534/tid=31535] ppid=31532 vsize=241524 CPUtime=4.37
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 3831 0 0 0 122 315 0 0 16 0 5 0 1128055375 247320576 57483 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=241524 CPUtime=641.7
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 18008 0 0 0 64076 94 0 0 25 0 5 0 1128055375 247320576 57483 4294967295 134512640 135180984 3216881456 3086290796 134520875 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=241524 CPUtime=637.86
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 19165 0 0 0 63703 83 0 0 25 0 5 0 1128055375 247320576 57483 4294967295 134512640 135180984 3216881456 3086225256 134520863 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=241524 CPUtime=641.49
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 21157 0 0 0 63948 201 0 0 25 0 5 0 1128055375 247320576 57483 4294967295 134512640 135180984 3216881456 3086159728 134528211 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1925.42
Current children cumulated vsize (KiB) 241524

[startup+702.311 s]
/proc/loadavg: 2.99 2.99 2.91 4/104 1343
/proc/meminfo: memFree=2936800/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=249652 CPUtime=2105.28
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 64444 0 0 0 209807 721 0 0 18 0 5 0 1128055375 255643648 59655 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 62413 59655 68 164 0 62248 0
[pid=31534/tid=31535] ppid=31532 vsize=249652 CPUtime=4.54
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 3919 0 0 0 129 325 0 0 15 0 5 0 1128055375 255643648 59655 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=249652 CPUtime=701.67
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 18875 0 0 0 70071 96 0 0 25 0 5 0 1128055375 255643648 59655 4294967295 134512640 135180984 3216881456 3086290792 134520881 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=249652 CPUtime=697.68
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 19677 0 0 0 69680 88 0 0 25 0 5 0 1128055375 255643648 59655 4294967295 134512640 135180984 3216881456 3086225264 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=249652 CPUtime=701.4
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 21862 0 0 0 69928 212 0 0 25 0 5 0 1128055375 255643648 59655 4294967295 134512640 135180984 3216881456 3086159664 134523833 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2105.28
Current children cumulated vsize (KiB) 249652

[startup+762.315 s]
/proc/loadavg: 2.99 2.99 2.91 4/104 1532
/proc/meminfo: memFree=2927524/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=259588 CPUtime=2285.24
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 66564 0 0 0 227758 766 0 0 18 0 5 0 1128055375 265818112 61775 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 64897 61775 68 164 0 64732 0
[pid=31534/tid=31535] ppid=31532 vsize=259588 CPUtime=4.79
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 4050 0 0 0 133 346 0 0 15 0 5 0 1128055375 265818112 61775 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=259588 CPUtime=761.66
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 19828 0 0 0 76066 100 0 0 25 0 5 0 1128055375 265818112 61775 4294967295 134512640 135180984 3216881456 3086290800 134528211 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=259588 CPUtime=757.42
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 20141 0 0 0 75648 94 0 0 25 0 5 0 1128055375 265818112 61775 4294967295 134512640 135180984 3216881456 3086225264 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=259588 CPUtime=761.38
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 22434 0 0 0 75912 226 0 0 25 0 5 0 1128055375 265818112 61775 4294967295 134512640 135180984 3216881456 3086159728 134528470 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2285.24
Current children cumulated vsize (KiB) 259588

[startup+822.309 s]
/proc/loadavg: 2.99 2.99 2.91 4/104 1724
/proc/meminfo: memFree=2919440/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=269508 CPUtime=2465.14
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 68754 0 0 0 245709 805 0 0 18 0 5 0 1128055375 275976192 63965 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 67377 63965 68 164 0 67212 0
[pid=31534/tid=31535] ppid=31532 vsize=269508 CPUtime=5.05
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 4163 0 0 0 140 365 0 0 15 0 5 0 1128055375 275976192 63965 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=269508 CPUtime=821.65
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 20831 0 0 0 82060 105 0 0 25 0 5 0 1128055375 275976192 63965 4294967295 134512640 135180984 3216881456 3086290800 134528267 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=269508 CPUtime=817.12
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 20688 0 0 0 81616 96 0 0 25 0 5 0 1128055375 275976192 63965 4294967295 134512640 135180984 3216881456 3086225264 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=269508 CPUtime=821.33
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 22961 0 0 0 81894 239 0 0 25 0 5 0 1128055375 275976192 63965 4294967295 134512640 135180984 3216881456 3086159728 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2465.14
Current children cumulated vsize (KiB) 269508

[startup+882.314 s]
/proc/loadavg: 2.99 2.99 2.91 4/104 1911
/proc/meminfo: memFree=2910776/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=277544 CPUtime=2645.03
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 70950 0 0 0 263646 857 0 0 18 0 5 0 1128055375 284205056 66161 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 69386 66161 68 164 0 69221 0
[pid=31534/tid=31535] ppid=31532 vsize=277544 CPUtime=5.38
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 4317 0 0 0 150 388 0 0 16 0 5 0 1128055375 284205056 66161 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=277544 CPUtime=881.65
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 21630 0 0 0 88053 112 0 0 25 0 5 0 1128055375 284205056 66161 4294967295 134512640 135180984 3216881456 3086290796 134519895 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=277544 CPUtime=876.74
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 21188 0 0 0 87572 102 0 0 25 0 5 0 1128055375 284205056 66161 4294967295 134512640 135180984 3216881456 3086225264 134528211 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=277544 CPUtime=881.27
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 23704 0 0 0 87872 255 0 0 25 0 5 0 1128055375 284205056 66161 4294967295 134512640 135180984 3216881456 3086159720 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2645.03
Current children cumulated vsize (KiB) 277544

[startup+942.308 s]
/proc/loadavg: 2.99 2.99 2.91 4/104 2099
/proc/meminfo: memFree=2903320/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=286476 CPUtime=2824.83
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 72831 0 0 0 281599 884 0 0 18 0 5 0 1128055375 293351424 68042 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 71619 68042 68 164 0 71454 0
[pid=31534/tid=31535] ppid=31532 vsize=286476 CPUtime=5.54
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 4465 0 0 0 154 400 0 0 16 0 5 0 1128055375 293351424 68042 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=286476 CPUtime=941.63
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 22308 0 0 0 94046 117 0 0 25 0 5 0 1128055375 293351424 68042 4294967295 134512640 135180984 3216881456 3086290632 134675767 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=286476 CPUtime=936.55
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 21690 0 0 0 93552 103 0 0 25 0 5 0 1128055375 293351424 68042 4294967295 134512640 135180984 3216881456 3086225328 134532489 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=286476 CPUtime=941.12
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 24257 0 0 0 93848 264 0 0 25 0 5 0 1128055375 293351424 68042 4294967295 134512640 135180984 3216881456 3086159728 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2824.83
Current children cumulated vsize (KiB) 286476



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000 s]
/proc/loadavg: 2.99 2.99 2.91 5/104 2286
/proc/meminfo: memFree=2894120/3368532 swapFree=1953580/1959888
[pid=31534] ppid=31532 vsize=293872 CPUtime=2997.79
/proc/31534/stat : 31534 (satake) S 31532 31534 21929 0 -1 4202496 74909 0 0 0 298832 947 0 0 18 0 5 0 1128055375 300924928 70120 4294967295 134512640 135180984 3216881456 3216880892 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/31534/statm: 73468 70120 68 164 0 73303 0
[pid=31534/tid=31535] ppid=31532 vsize=293872 CPUtime=5.89
/proc/31534/task/31535/stat : 31535 (satake) S 31532 31534 21929 0 -1 4202560 4592 0 0 0 161 428 0 0 16 0 5 0 1128055375 300924928 70120 4294967295 134512640 135180984 3216881456 3086356496 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=31534/tid=31536] ppid=31532 vsize=293872 CPUtime=999.34
/proc/31534/task/31536/stat : 31536 (satake) R 31532 31534 21929 0 -1 4202560 23091 0 0 0 99807 127 0 0 25 0 5 0 1128055375 300924928 70120 4294967295 134512640 135180984 3216881456 3086290732 134523872 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=31534/tid=31537] ppid=31532 vsize=293872 CPUtime=994.11
/proc/31534/task/31537/stat : 31537 (satake) R 31532 31534 21929 0 -1 4202560 22359 0 0 0 99293 118 0 0 25 0 5 0 1128055375 300924928 70120 4294967295 134512640 135180984 3216881456 3086225264 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=31534/tid=31538] ppid=31532 vsize=293872 CPUtime=998.45
/proc/31534/task/31538/stat : 31538 (satake) R 31532 31534 21929 0 -1 4202560 24756 0 0 0 99571 274 0 0 25 0 5 0 1128055375 300924928 70120 4294967295 134512640 135180984 3216881456 3086159728 134528680 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2997.79
Current children cumulated vsize (KiB) 293872

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.03
CPU time (s): 2997.81
CPU user time (s): 2988.33
CPU system time (s): 9.48
CPU usage (%): 299.772
Max. virtual memory (cumulated for all children) (KiB): 293872

deleting IPC queue 1572864
deleting IPC queue 1605633
deleting IPC queue 1638402
deleting IPC queue 1671171
deleting IPC queue 1703940
deleting IPC queue 1736709
deleting IPC queue 1769478
deleting IPC queue 1802247
deleting IPC queue 1835016
deleting IPC queue 1867785
deleting IPC queue 1900554
deleting IPC queue 1933323
deleting IPC queue 1966092
deleting IPC queue 1998861
deleting IPC queue 2031630
deleting IPC queue 2064399

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2988.33
system time used= 9.48
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 74909
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 606588
involuntary context switches= 524281

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-29 23:51:49
IDJOB=1775965
IDBENCH=20406
IDSOLVER=629
FILE ID=/1775965-1243633909
PBS_JOBID=
Free space on /tmp= 15879 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT07/industrial/palacios/hard/sortnet-7-ipc5-h15-unsat.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1775965-1243633909/watcher-1775965-1243633909 -o /tmp/evaluation-result-1775965-1243633909/solver-1775965-1243633909 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1775965-1243633909.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 0683489092a5eb0c881dd17c2c45d08e
RANDOM SEED= 1903312983

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3176088 kB
Buffers:         37928 kB
Cached:          77216 kB
SwapCached:       2424 kB
Active:          98648 kB
Inactive:        26832 kB
HighTotal:     2489216 kB
HighFree:      2399552 kB
LowTotal:       879316 kB
LowFree:        776536 kB
SwapTotal:     1959888 kB
SwapFree:      1953580 kB
Dirty:            7272 kB
Writeback:           0 kB
AnonPages:        9420 kB
Mapped:           4984 kB
Slab:            57288 kB
SReclaimable:    49276 kB
SUnreclaim:       8012 kB
PageTables:        508 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:    93560 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15879 MiB
End job on  at 2009-05-30 00:08:32