Trace number 1775920

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 3002.2 1000.06

General information on the benchmark

Nameindustrial/fuhs/hard/
AProVE07-26.cnf
MD5SUM0cf155110f71a43081221b427d368ee8
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables21734
Number of clauses79766
Sum of the clauses size211276
Maximum clause length225
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 236916
Number of clauses of size 338055
Number of clauses of size 43077
Number of clauses of size 5748
Number of clauses of size over 5969

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1775920-1243634446/watcher-1775920-1243634446 -o /tmp/evaluation-result-1775920-1243634446/solver-1775920-1243634446 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1775920-1243634446.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 3.00 3.00 2.84 3/115 20974
/proc/meminfo: memFree=3120616/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=5264 CPUtime=0.01
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 691 0 0 0 0 1 0 0 18 0 5 0 1128124415 5390336 648 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 1316 650 63 164 0 1151 0
[pid=20974/tid=20975] ppid=20972 vsize=5264 CPUtime=0
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128124415 5390336 661 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=5264 CPUtime=0.01
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 591 0 0 0 0 1 0 0 20 0 5 0 1128124415 5390336 665 4294967295 134512640 135180984 3219204464 3086110792 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=5264 CPUtime=0
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1128124415 5390336 667 4294967295 134512640 135180984 3219204464 3086046020 134705812 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=5264 CPUtime=0
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1128124415 5390336 669 4294967295 134512640 135180984 3219204464 3085980484 134705812 0 0 0 0 0 0 0 -1 3 0 0 0

[startup+0.081515 s]
/proc/loadavg: 3.00 3.00 2.84 3/115 20974
/proc/meminfo: memFree=3120616/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=22212 CPUtime=0.17
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 4355 0 0 0 14 3 0 0 18 0 5 0 1128124415 22745088 4312 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 5553 4314 63 164 0 5388 0
[pid=20974/tid=20975] ppid=20972 vsize=22212 CPUtime=0
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1128124415 22745088 4314 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=22212 CPUtime=0.06
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 1476 0 0 0 5 1 0 0 20 0 5 0 1128124415 22745088 4315 4294967295 134512640 135180984 3219204464 3086111024 134535027 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=22212 CPUtime=0.06
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 1418 0 0 0 4 2 0 0 20 0 5 0 1128124415 22745088 4316 4294967295 134512640 135180984 3219204464 3086045472 134513642 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=22212 CPUtime=0.05
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 1347 0 0 0 5 0 0 0 20 0 5 0 1128124415 22745088 4316 4294967295 134512640 135180984 3219204464 3085979936 134513592 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 22212

[startup+0.111516 s]
/proc/loadavg: 3.00 3.00 2.84 3/115 20974
/proc/meminfo: memFree=3120616/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=24056 CPUtime=0.26
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 5155 0 0 0 22 4 0 0 18 0 5 0 1128124415 24633344 4769 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 6014 4769 66 164 0 5849 0
[pid=20974/tid=20975] ppid=20972 vsize=24056 CPUtime=0
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 390 0 0 0 0 0 0 0 18 0 5 0 1128124415 24633344 4769 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=24056 CPUtime=0.09
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 1569 0 0 0 7 2 0 0 20 0 5 0 1128124415 24633344 4769 4294967295 134512640 135180984 3219204464 3086110512 134523819 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=24056 CPUtime=0.09
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 1547 0 0 0 7 2 0 0 20 0 5 0 1128124415 24633344 4769 4294967295 134512640 135180984 3219204464 3086045272 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=24056 CPUtime=0.08
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 1539 0 0 0 8 0 0 0 20 0 5 0 1128124415 24633344 4769 4294967295 134512640 135180984 3219204464 3085980052 134702225 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 24056

[startup+0.311505 s]
/proc/loadavg: 3.00 3.00 2.84 3/115 20974
/proc/meminfo: memFree=3120616/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=22724 CPUtime=0.86
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 5389 0 0 0 77 9 0 0 18 0 5 0 1128124415 23269376 4317 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 5681 4317 68 164 0 5516 0
[pid=20974/tid=20975] ppid=20972 vsize=22724 CPUtime=0.02
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 402 0 0 0 0 2 0 0 17 0 5 0 1128124415 23269376 4317 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=22724 CPUtime=0.29
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 1624 0 0 0 26 3 0 0 20 0 5 0 1128124415 23269376 4317 4294967295 134512640 135180984 3219204464 3086110568 134518263 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=22724 CPUtime=0.27
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 1624 0 0 0 24 3 0 0 20 0 5 0 1128124415 23269376 4317 4294967295 134512640 135180984 3219204464 3086045040 134528470 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=22724 CPUtime=0.28
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 1629 0 0 0 27 1 0 0 20 0 5 0 1128124415 23269376 4317 4294967295 134512640 135180984 3219204464 3085979504 134526240 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.86
Current children cumulated vsize (KiB) 22724

[startup+0.711492 s]
/proc/loadavg: 3.00 3.00 2.84 3/115 20974
/proc/meminfo: memFree=3120616/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=23252 CPUtime=2.01
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 5615 0 0 0 180 21 0 0 18 0 5 0 1128124415 23810048 4543 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 5813 4543 68 164 0 5648 0
[pid=20974/tid=20975] ppid=20972 vsize=23252 CPUtime=0.12
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 435 0 0 0 5 7 0 0 16 0 5 0 1128124415 23810048 4543 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=23252 CPUtime=0.67
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 1689 0 0 0 63 4 0 0 21 0 5 0 1128124415 23810048 4543 4294967295 134512640 135180984 3219204464 3086110568 134520863 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=23252 CPUtime=0.57
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 1671 0 0 0 52 5 0 0 21 0 5 0 1128124415 23810048 4543 4294967295 134512640 135180984 3219204464 3086044976 134523809 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=23252 CPUtime=0.65
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 1710 0 0 0 60 5 0 0 20 0 5 0 1128124415 23810048 4543 4294967295 134512640 135180984 3219204464 3085979504 134526704 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.01
Current children cumulated vsize (KiB) 23252

[startup+1.51146 s]
/proc/loadavg: 3.08 3.02 2.84 4/120 20979
/proc/meminfo: memFree=3103712/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=25604 CPUtime=4.34
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 6190 0 0 0 390 44 0 0 18 0 5 0 1128124415 26218496 5118 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 6401 5118 68 164 0 6236 0
[pid=20974/tid=20975] ppid=20972 vsize=25604 CPUtime=0.31
/proc/20974/task/20975/stat : 20975 (satake) R 20972 20974 11369 0 -1 4202560 511 0 0 0 10 21 0 0 16 0 5 0 1128124415 26218496 5118 4294967295 134512640 135180984 3219204464 3086176284 134706407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=25604 CPUtime=1.45
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 1889 0 0 0 138 7 0 0 22 0 5 0 1128124415 26218496 5118 4294967295 134512640 135180984 3219204464 3086110472 134519103 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=25604 CPUtime=1.18
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 1793 0 0 0 113 5 0 0 22 0 5 0 1128124415 26218496 5118 4294967295 134512640 135180984 3219204464 3086044976 134523762 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=25604 CPUtime=1.4
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 1887 0 0 0 129 11 0 0 20 0 5 0 1128124415 26218496 5118 4294967295 134512640 135180984 3219204464 3085979300 134580588 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.34
Current children cumulated vsize (KiB) 25604

[startup+3.1114 s]
/proc/loadavg: 3.08 3.02 2.84 4/120 20980
/proc/meminfo: memFree=3099764/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=29128 CPUtime=9.13
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 7242 0 0 0 838 75 0 0 18 0 5 0 1128124415 29827072 6170 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 7282 6170 68 164 0 7117 0
[pid=20974/tid=20975] ppid=20972 vsize=29128 CPUtime=0.54
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 584 0 0 0 19 35 0 0 16 0 5 0 1128124415 29827072 6170 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=29128 CPUtime=3.05
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 2180 0 0 0 294 11 0 0 25 0 5 0 1128124415 29827072 6170 4294967295 134512640 135180984 3219204464 3086110576 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=29128 CPUtime=2.55
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 2127 0 0 0 247 8 0 0 25 0 5 0 1128124415 29827072 6170 4294967295 134512640 135180984 3219204464 3086044872 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=29128 CPUtime=2.99
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 2241 0 0 0 278 21 0 0 21 0 5 0 1128124415 29827072 6170 4294967295 134512640 135180984 3219204464 3085979496 134520863 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.13
Current children cumulated vsize (KiB) 29128

[startup+6.31127 s]
/proc/loadavg: 3.08 3.02 2.84 4/120 20980
/proc/meminfo: memFree=3091692/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=38160 CPUtime=18.81
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 9393 0 0 0 1750 131 0 0 18 0 5 0 1128124415 39075840 8321 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 9540 8321 68 164 0 9375 0
[pid=20974/tid=20975] ppid=20972 vsize=38160 CPUtime=0.91
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 731 0 0 0 30 61 0 0 16 0 5 0 1128124415 39075840 8321 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=38160 CPUtime=6.23
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 2905 0 0 0 604 19 0 0 25 0 5 0 1128124415 39075840 8321 4294967295 134512640 135180984 3219204464 3086110292 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=38160 CPUtime=5.57
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 2799 0 0 0 535 22 0 0 25 0 5 0 1128124415 39075840 8321 4294967295 134512640 135180984 3219204464 3086045040 134528211 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=38160 CPUtime=6.1
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 2848 0 0 0 581 29 0 0 25 0 5 0 1128124415 39075840 8321 4294967295 134512640 135180984 3219204464 3085979504 134528543 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 18.81
Current children cumulated vsize (KiB) 38160

[startup+12.711 s]
/proc/loadavg: 3.07 3.02 2.84 4/120 20980
/proc/meminfo: memFree=3075564/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=52420 CPUtime=38.42
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 13056 0 0 0 3630 212 0 0 18 0 5 0 1128124415 53678080 11984 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 13105 11984 68 164 0 12940 0
[pid=20974/tid=20975] ppid=20972 vsize=52420 CPUtime=1.39
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 914 0 0 0 41 98 0 0 16 0 5 0 1128124415 53678080 11984 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=52420 CPUtime=12.6
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 4242 0 0 0 1222 38 0 0 25 0 5 0 1128124415 53678080 11984 4294967295 134512640 135180984 3219204464 3086110576 134528633 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=52420 CPUtime=11.96
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 3734 0 0 0 1161 35 0 0 25 0 5 0 1128124415 53678080 11984 4294967295 134512640 135180984 3219204464 3086045040 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=52420 CPUtime=12.47
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 4056 0 0 0 1206 41 0 0 25 0 5 0 1128124415 53678080 11984 4294967295 134512640 135180984 3219204464 3085979504 134528628 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38.42
Current children cumulated vsize (KiB) 52420

[startup+25.5105 s]
/proc/loadavg: 3.06 3.01 2.84 4/120 20981
/proc/meminfo: memFree=3046896/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=80776 CPUtime=77.44
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 20045 0 0 0 7414 330 0 0 18 0 5 0 1128124415 82714624 18973 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 20194 18973 68 164 0 20029 0
[pid=20974/tid=20975] ppid=20972 vsize=80776 CPUtime=2.09
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 1144 0 0 0 55 154 0 0 16 0 5 0 1128124415 82714624 18973 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=80776 CPUtime=25.37
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 6236 0 0 0 2470 67 0 0 25 0 5 0 1128124415 82714624 18973 4294967295 134512640 135180984 3219204464 3086110480 134524648 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=80776 CPUtime=24.75
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 5697 0 0 0 2419 56 0 0 25 0 5 0 1128124415 82714624 18973 4294967295 134512640 135180984 3219204464 3086045040 134526345 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=80776 CPUtime=25.23
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 6858 0 0 0 2470 53 0 0 25 0 5 0 1128124415 82714624 18973 4294967295 134512640 135180984 3219204464 3085979408 134524418 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 77.44
Current children cumulated vsize (KiB) 80776

[startup+51.1095 s]
/proc/loadavg: 3.04 3.01 2.85 4/120 21167
/proc/meminfo: memFree=3003836/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=124112 CPUtime=154.42
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 30701 0 0 0 14972 470 0 0 18 0 5 0 1128124415 127090688 29629 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 31028 29629 68 164 0 30863 0
[pid=20974/tid=20975] ppid=20972 vsize=124112 CPUtime=2.83
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 1402 0 0 0 70 213 0 0 16 0 5 0 1128124415 127090688 29629 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=124112 CPUtime=50.89
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 9692 0 0 0 4984 105 0 0 25 0 5 0 1128124415 127090688 29629 4294967295 134512640 135180984 3219204464 3086110408 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=124112 CPUtime=50.3
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 8609 0 0 0 4944 86 0 0 25 0 5 0 1128124415 127090688 29629 4294967295 134512640 135180984 3219204464 3086044872 134675846 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=124112 CPUtime=50.4
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 10888 0 0 0 4974 66 0 0 25 0 5 0 1128124415 127090688 29629 4294967295 134512640 135180984 3219204464 3085979568 134532467 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 154.42
Current children cumulated vsize (KiB) 124112

[startup+102.317 s]
/proc/loadavg: 3.01 3.01 2.85 4/120 21353

################
# More data... #
################

[pid=20974/tid=20976] ppid=20972 vsize=270464 CPUtime=520.86
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 19709 0 0 0 51646 440 0 0 25 0 5 0 1128124415 276955136 65169 4294967295 134512640 135180984 3219204464 3086110576 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=270464 CPUtime=512.75
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 24265 0 0 0 50952 323 0 0 25 0 5 0 1128124415 276955136 65169 4294967295 134512640 135180984 3219204464 3086044832 134580407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=270464 CPUtime=520.67
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 17317 0 0 0 51547 520 0 0 25 0 5 0 1128124415 276955136 65169 4294967295 134512640 135180984 3219204464 3085979504 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1569.24
Current children cumulated vsize (KiB) 270464

[startup+582.308 s]
/proc/loadavg: 3.08 3.03 2.91 4/120 22863
/proc/meminfo: memFree=2858336/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=270792 CPUtime=1749.59
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 66339 0 0 0 172402 2557 0 0 18 0 5 0 1128124415 277291008 65267 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 67698 65267 68 164 0 67533 0
[pid=20974/tid=20975] ppid=20972 vsize=270792 CPUtime=15.6
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 4878 0 0 0 356 1204 0 0 15 0 5 0 1128124415 277291008 65267 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=270792 CPUtime=580.74
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 19709 0 0 0 57606 468 0 0 25 0 5 0 1128124415 277291008 65267 4294967295 134512640 135180984 3219204464 3086110576 134528557 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=270792 CPUtime=572.62
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 24267 0 0 0 56924 338 0 0 25 0 5 0 1128124415 277291008 65267 4294967295 134512640 135180984 3219204464 3086045040 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=270792 CPUtime=580.64
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 17375 0 0 0 57517 547 0 0 25 0 5 0 1128124415 277291008 65267 4294967295 134512640 135180984 3219204464 3085979504 134528546 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1749.59
Current children cumulated vsize (KiB) 270792

[startup+642.316 s]
/proc/loadavg: 3.03 3.02 2.91 4/120 23051
/proc/meminfo: memFree=2858040/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=271272 CPUtime=1929.54
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 66564 0 0 0 190331 2623 0 0 18 0 5 0 1128124415 277782528 65492 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 67818 65492 68 164 0 67653 0
[pid=20974/tid=20975] ppid=20972 vsize=271272 CPUtime=16.03
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 4929 0 0 0 367 1236 0 0 15 0 5 0 1128124415 277782528 65492 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=271272 CPUtime=640.37
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 19740 0 0 0 63557 480 0 0 25 0 5 0 1128124415 277782528 65492 4294967295 134512640 135180984 3219204464 3086110472 134520909 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=271272 CPUtime=632.5
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 24357 0 0 0 62900 350 0 0 25 0 5 0 1128124415 277782528 65492 4294967295 134512640 135180984 3219204464 3086045040 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=271272 CPUtime=640.64
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 17428 0 0 0 63507 557 0 0 25 0 5 0 1128124415 277782528 65492 4294967295 134512640 135180984 3219204464 3085979504 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1929.54
Current children cumulated vsize (KiB) 271272

[startup+702.313 s]
/proc/loadavg: 3.04 3.03 2.92 4/120 23241
/proc/meminfo: memFree=2855808/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=272952 CPUtime=2109.29
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 67064 0 0 0 208130 2799 0 0 18 0 5 0 1128124415 279502848 65992 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 68238 65992 68 164 0 68073 0
[pid=20974/tid=20975] ppid=20972 vsize=272952 CPUtime=17.22
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 5085 0 0 0 395 1327 0 0 16 0 5 0 1128124415 279502848 65992 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=272952 CPUtime=699.72
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 19907 0 0 0 69464 508 0 0 25 0 5 0 1128124415 279502848 65992 4294967295 134512640 135180984 3219204464 3086110480 134524655 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=272952 CPUtime=691.8
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 24533 0 0 0 68808 372 0 0 25 0 5 0 1128124415 279502848 65992 4294967295 134512640 135180984 3219204464 3086044992 134527255 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=272952 CPUtime=700.55
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 17429 0 0 0 69463 592 0 0 25 0 5 0 1128124415 279502848 65992 4294967295 134512640 135180984 3219204464 3085979504 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2109.29
Current children cumulated vsize (KiB) 272952

[startup+762.311 s]
/proc/loadavg: 3.09 3.04 2.92 4/120 23429
/proc/meminfo: memFree=2826084/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=303672 CPUtime=2289.38
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 74718 0 0 0 225943 2995 0 0 18 0 5 0 1128124415 310960128 73646 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 75918 73646 68 164 0 75753 0
[pid=20974/tid=20975] ppid=20972 vsize=303672 CPUtime=18.37
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 5459 0 0 0 417 1420 0 0 16 0 5 0 1128124415 310960128 73646 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=303672 CPUtime=759.67
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 20331 0 0 0 75420 547 0 0 25 0 5 0 1128124415 310960128 73646 4294967295 134512640 135180984 3219204464 3086110576 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=303672 CPUtime=751.44
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 24749 0 0 0 74734 410 0 0 25 0 5 0 1128124415 310960128 73646 4294967295 134512640 135180984 3219204464 3086045040 134528658 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=303672 CPUtime=759.91
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 24069 0 0 0 75373 618 0 0 25 0 5 0 1128124415 310960128 73646 4294967295 134512640 135180984 3219204464 3085979504 134528543 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2289.38
Current children cumulated vsize (KiB) 303672

[startup+822.309 s]
/proc/loadavg: 3.03 3.03 2.92 4/120 23617
/proc/meminfo: memFree=2793796/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=336420 CPUtime=2469.8
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 82882 0 0 0 243867 3113 0 0 18 0 5 0 1128124415 344494080 81810 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 84105 81810 68 164 0 83940 0
[pid=20974/tid=20975] ppid=20972 vsize=336420 CPUtime=19.16
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 5715 0 0 0 438 1478 0 0 16 0 5 0 1128124415 344494080 81810 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=336420 CPUtime=819.41
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 22997 0 0 0 81376 565 0 0 25 0 5 0 1128124415 344494080 81810 4294967295 134512640 135180984 3219204464 3086110408 134675767 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=336420 CPUtime=811.35
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 28701 0 0 0 80692 443 0 0 25 0 5 0 1128124415 344494080 81810 4294967295 134512640 135180984 3219204464 3086044936 134519101 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=336420 CPUtime=819.88
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 25359 0 0 0 81361 627 0 0 25 0 5 0 1128124415 344494080 81810 4294967295 134512640 135180984 3219204464 3085979408 134525462 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2469.8
Current children cumulated vsize (KiB) 336420

[startup+882.306 s]
/proc/loadavg: 3.05 3.03 2.93 4/120 23806
/proc/meminfo: memFree=2785292/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=341964 CPUtime=2649.5
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 84365 0 0 0 261731 3219 0 0 18 0 5 0 1128124415 350171136 83293 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 85491 83293 68 164 0 85326 0
[pid=20974/tid=20975] ppid=20972 vsize=341964 CPUtime=19.96
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 5745 0 0 0 460 1536 0 0 16 0 5 0 1128124415 350171136 83293 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 2 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=341964 CPUtime=878.52
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 23618 0 0 0 87276 576 0 0 25 0 5 0 1128124415 350171136 83293 4294967295 134512640 135180984 3219204464 3086110472 134519101 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=341964 CPUtime=871.16
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 29518 0 0 0 86655 461 0 0 25 0 5 0 1128124415 350171136 83293 4294967295 134512640 135180984 3219204464 3086045040 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=341964 CPUtime=879.86
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 25374 0 0 0 87340 646 0 0 25 0 5 0 1128124415 350171136 83293 4294967295 134512640 135180984 3219204464 3085979504 134528583 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2649.5
Current children cumulated vsize (KiB) 341964

[startup+942.304 s]
/proc/loadavg: 3.02 3.03 2.93 4/120 23994
/proc/meminfo: memFree=2783168/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=346224 CPUtime=2829.24
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 85201 0 0 0 279594 3330 0 0 18 0 5 0 1128124415 354533376 84129 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 86556 84129 68 164 0 86391 0
[pid=20974/tid=20975] ppid=20972 vsize=346224 CPUtime=20.73
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 5806 0 0 0 478 1595 0 0 16 0 5 0 1128124415 354533376 84129 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=346224 CPUtime=937.76
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 23634 0 0 0 93185 591 0 0 25 0 5 0 1128124415 354533376 84129 4294967295 134512640 135180984 3219204464 3086110576 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=346224 CPUtime=930.92
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 29556 0 0 0 92617 475 0 0 25 0 5 0 1128124415 354533376 84129 4294967295 134512640 135180984 3219204464 3086045152 134531534 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=346224 CPUtime=939.84
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 26095 0 0 0 93315 669 0 0 25 0 5 0 1128124415 354533376 84129 4294967295 134512640 135180984 3219204464 3085979440 134523641 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2829.24
Current children cumulated vsize (KiB) 346224



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 3.00 3.02 2.93 4/120 24183
/proc/meminfo: memFree=2758548/3368532 swapFree=1941392/1959888
[pid=20974] ppid=20972 vsize=370332 CPUtime=3002.13
/proc/20974/stat : 20974 (satake) S 20972 20974 11369 0 -1 4202496 91513 0 0 0 296799 3414 0 0 18 0 5 0 1128124415 379219968 90441 4294967295 134512640 135180984 3219204464 3219203900 134573496 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/20974/statm: 92583 90441 68 164 0 92418 0
[pid=20974/tid=20975] ppid=20972 vsize=370332 CPUtime=21.26
/proc/20974/task/20975/stat : 20975 (satake) S 20972 20974 11369 0 -1 4202560 6022 0 0 0 493 1633 0 0 16 0 5 0 1128124415 379219968 90441 4294967295 134512640 135180984 3219204464 3086176272 134580407 0 0 0 0 3223036458 0 0 -1 3 0 0 0
[pid=20974/tid=20976] ppid=20972 vsize=370332 CPUtime=995.39
/proc/20974/task/20976/stat : 20976 (satake) R 20972 20974 11369 0 -1 4202560 24235 0 0 0 98935 604 0 0 25 0 5 0 1128124415 379219968 90441 4294967295 134512640 135180984 3219204464 3086110408 134675846 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=20974/tid=20977] ppid=20972 vsize=370332 CPUtime=987.96
/proc/20974/task/20977/stat : 20977 (satake) R 20972 20974 11369 0 -1 4202560 30018 0 0 0 98304 492 0 0 25 0 5 0 1128124415 379219968 90441 4294967295 134512640 135180984 3219204464 3086045040 134528433 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=20974/tid=20978] ppid=20972 vsize=370332 CPUtime=997.52
/proc/20974/task/20978/stat : 20978 (satake) R 20972 20974 11369 0 -1 4202560 31128 0 0 0 99067 685 0 0 25 0 5 0 1128124415 379219968 90441 4294967295 134512640 135180984 3219204464 3085979496 134518214 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3002.13
Current children cumulated vsize (KiB) 370332

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.06
CPU time (s): 3002.2
CPU user time (s): 2968.03
CPU system time (s): 34.17
CPU usage (%): 300.203
Max. virtual memory (cumulated for all children) (KiB): 370332

deleting IPC queue 1572864
deleting IPC queue 1605633
deleting IPC queue 1638402
deleting IPC queue 1671171
deleting IPC queue 1703940
deleting IPC queue 1736709
deleting IPC queue 1769478
deleting IPC queue 1802247
deleting IPC queue 1835016
deleting IPC queue 1867785
deleting IPC queue 1900554
deleting IPC queue 1933323
deleting IPC queue 1966092
deleting IPC queue 1998861
deleting IPC queue 2031630
deleting IPC queue 2064399

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2968.03
system time used= 34.17
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 91518
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1897691
involuntary context switches= 1264389

runsolver used 0 second user time and 0.01 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 00:00:46
IDJOB=1775920
IDBENCH=20403
IDSOLVER=629
FILE ID=/1775920-1243634446
PBS_JOBID=
Free space on /tmp= 15729 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT07/industrial/fuhs/hard/AProVE07-26.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1775920-1243634446/watcher-1775920-1243634446 -o /tmp/evaluation-result-1775920-1243634446/solver-1775920-1243634446 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1775920-1243634446.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 0cf155110f71a43081221b427d368ee8
RANDOM SEED= 548190844

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3120616 kB
Buffers:         39900 kB
Cached:         127996 kB
SwapCached:       4320 kB
Active:         132516 kB
Inactive:        45920 kB
HighTotal:     2489216 kB
HighFree:      2348092 kB
LowTotal:       879316 kB
LowFree:        772524 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            2248 kB
Writeback:           0 kB
AnonPages:        9328 kB
Mapped:           4332 kB
Slab:            58408 kB
SReclaimable:    50172 kB
SUnreclaim:       8236 kB
PageTables:        772 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127080 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15729 MiB
End job on  at 2009-05-30 00:17:28