Trace number 3312068

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.29 1207.16

General information on the benchmark

NameSAT05/industrial/grieu05/vmpc/
vmpc_35.renamed-as.sat05-1921.cnf
MD5SUM5fda0e0fb8a21967728dfe29bf2d4ea5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark473.18
Satisfiable
(Un)Satisfiability was proved
Number of variables1225
Number of clauses211785
Sum of the clauses size554190
Maximum clause length35
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 283405
Number of clauses of size 3128310
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 570

Solver Data 

0.10/0.12	32:08 INFO : Reading from input HOME/instance-3312068-1304188328.cnf
1.11/0.96	Executor set job limit to 1000000
1.11/0.96	Executor set job limit to 1000000
1.11/0.96	Executor set job limit to 1000000
1.11/0.96	Executor set job limit to 1000000
1.11/0.96	Starting Executor!
1.11/0.96	Starting Executor!
1.11/0.96	Starting Executor!
1.11/0.96	Starting Executor!
4.20/2.68	32:10 INFO : 1224 variables remaining out of 1225
4.20/2.68	32:10 INFO : 700608 literals remaining out of 765975

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312068-1304188328/watcher-3312068-1304188328 -o /tmp/evaluation-result-3312068-1304188328/solver-3312068-1304188328 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312068-1304188328.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.56 6.17 7.04 3/174 7986
/proc/meminfo: memFree=25121172/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=23028 CPUtime=0 cores=0,2,4,6
/proc/7986/stat : 7986 (java) R 7984 7986 7120 0 -1 4202496 901 0 0 0 0 0 0 0 23 0 1 0 511248628 23580672 388 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233505335061 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/7986/statm: 5757 401 311 9 0 124 0

[startup+0.0462561 s]
/proc/loadavg: 2.56 6.17 7.04 3/174 7986
/proc/meminfo: memFree=25121172/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15669652 CPUtime=0.03 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 3829 0 1 0 3 0 0 0 23 0 13 0 511248628 16045723648 3270 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800971 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3917413 3272 1683 9 0 3908161 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 15669652

[startup+0.100232 s]
/proc/loadavg: 2.56 6.17 7.04 3/174 7986
/proc/meminfo: memFree=25121172/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15676260 CPUtime=0.1 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 5456 0 1 0 9 1 0 0 23 0 18 0 511248628 16052490240 4896 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3919065 4896 2115 9 0 3909784 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676260

[startup+0.300177 s]
/proc/loadavg: 2.56 6.17 7.04 3/174 7986
/proc/meminfo: memFree=25121172/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15679708 CPUtime=0.5 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 14089 0 1 0 48 2 0 0 23 0 18 0 511248628 16056020992 12591 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3919927 12597 2212 9 0 3910646 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 15679708

[startup+0.701169 s]
/proc/loadavg: 2.56 6.17 7.04 3/174 7986
/proc/meminfo: memFree=25121172/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15679708 CPUtime=0.91 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 41765 0 1 0 85 6 0 0 23 0 18 0 511248628 16056020992 40264 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3919927 40264 2228 9 0 3910646 0
Current children cumulated CPU time (s) 0.91
Current children cumulated vsize (KiB) 15679708

[startup+1.50103 s]
/proc/loadavg: 2.56 6.17 7.04 5/216 8031
/proc/meminfo: memFree=24806484/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15685800 CPUtime=2.19 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 51720 0 1 0 211 8 0 0 23 0 22 0 511248628 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3921450 46390 2254 9 0 3912169 0
[pid=7986/tid=7988] ppid=7984 vsize=15685800 CPUtime=1.46 cores=0,2,4,6
/proc/7986/task/7988/stat : 7988 (java) R 7984 7986 7120 0 -1 4202560 35616 0 1 0 141 5 0 0 20 0 22 0 511248629 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 47850757904312 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=7986/tid=7989] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7989/stat : 7989 (java) S 7984 7986 7120 0 -1 4202560 1376 0 0 0 0 0 0 0 16 0 22 0 511248630 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7990] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7990/stat : 7990 (java) S 7984 7986 7120 0 -1 4202560 665 0 0 0 0 0 0 0 17 0 22 0 511248630 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7991] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7991/stat : 7991 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 511248630 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7992] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7992/stat : 7992 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 22 0 511248630 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7993] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7993/stat : 7993 (java) S 7984 7986 7120 0 -1 4202560 298 0 0 0 0 0 0 0 17 0 22 0 511248630 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7994] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7994/stat : 7994 (java) S 7984 7986 7120 0 -1 4202560 11 0 0 0 0 0 0 0 17 0 22 0 511248630 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7995] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7995/stat : 7995 (java) S 7984 7986 7120 0 -1 4202560 67 0 0 0 0 0 0 0 16 0 22 0 511248630 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7996] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7996/stat : 7996 (java) S 7984 7986 7120 0 -1 4202560 375 0 0 0 0 0 0 0 15 0 22 0 511248630 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7998] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7998/stat : 7998 (java) S 7984 7986 7120 0 -1 4202560 73 0 0 0 0 0 0 0 17 0 22 0 511248631 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 0 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7999] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7999/stat : 7999 (java) S 7984 7986 7120 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 511248631 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8000] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8000/stat : 8000 (java) S 7984 7986 7120 0 -1 4202560 10 0 0 0 0 0 0 0 21 0 22 0 511248631 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8015] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8015/stat : 8015 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 511248633 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522121137 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8016] ppid=7984 vsize=15685800 CPUtime=0.14 cores=0,2,4,6
/proc/7986/task/8016/stat : 8016 (java) S 7984 7986 7120 0 -1 4202560 1110 0 0 0 14 0 0 0 15 0 22 0 511248633 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=8017] ppid=7984 vsize=15685800 CPUtime=0.55 cores=0,2,4,6
/proc/7986/task/8017/stat : 8017 (java) R 7984 7986 7120 0 -1 4202560 10698 0 0 0 53 2 0 0 16 0 22 0 511248634 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 47850759264670 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=7986/tid=8018] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8018/stat : 8018 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 511248634 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8019] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8019/stat : 8019 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 511248634 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=8028] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8028/stat : 8028 (java) S 7984 7986 7120 0 -1 4202560 13 0 0 0 0 0 0 0 15 0 22 0 511248725 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=8029] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8029/stat : 8029 (java) S 7984 7986 7120 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 511248725 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=8030] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8030/stat : 8030 (java) S 7984 7986 7120 0 -1 4202560 15 0 0 0 0 0 0 0 15 0 22 0 511248725 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=8031] ppid=7984 vsize=15685800 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8031/stat : 8031 (java) S 7984 7986 7120 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 511248725 16062259200 46390 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.19
Current children cumulated vsize (KiB) 15685800

[startup+3.10967 s]
/proc/loadavg: 2.67 6.13 7.02 6/220 8035
/proc/meminfo: memFree=24763548/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15685376 CPUtime=5.23 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 61247 0 1 0 513 10 0 0 23 0 22 0 511248628 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3921344 52801 2275 9 0 3912063 0
[pid=7986/tid=7988] ppid=7984 vsize=15685376 CPUtime=2.65 cores=0,2,4,6
/proc/7986/task/7988/stat : 7988 (java) S 7984 7986 7120 0 -1 4202560 35672 0 1 0 260 5 0 0 18 0 22 0 511248629 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7989] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7989/stat : 7989 (java) S 7984 7986 7120 0 -1 4202560 1376 0 0 0 0 0 0 0 16 0 22 0 511248630 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7990] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7990/stat : 7990 (java) S 7984 7986 7120 0 -1 4202560 665 0 0 0 0 0 0 0 17 0 22 0 511248630 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7991] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7991/stat : 7991 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 511248630 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7992] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7992/stat : 7992 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 22 0 511248630 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7993] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7993/stat : 7993 (java) S 7984 7986 7120 0 -1 4202560 298 0 0 0 0 0 0 0 17 0 22 0 511248630 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7994] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7994/stat : 7994 (java) S 7984 7986 7120 0 -1 4202560 11 0 0 0 0 0 0 0 17 0 22 0 511248630 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7995] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7995/stat : 7995 (java) S 7984 7986 7120 0 -1 4202560 67 0 0 0 0 0 0 0 16 0 22 0 511248630 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7996] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7996/stat : 7996 (java) S 7984 7986 7120 0 -1 4202560 375 0 0 0 0 0 0 0 15 0 22 0 511248630 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7998] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7998/stat : 7998 (java) S 7984 7986 7120 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 511248631 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 0 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7999] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7999/stat : 7999 (java) S 7984 7986 7120 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 511248631 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8000] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8000/stat : 8000 (java) S 7984 7986 7120 0 -1 4202560 10 0 0 0 0 0 0 0 21 0 22 0 511248631 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8015] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8015/stat : 8015 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 511248633 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522121137 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8016] ppid=7984 vsize=15685376 CPUtime=0.81 cores=0,2,4,6
/proc/7986/task/8016/stat : 8016 (java) R 7984 7986 7120 0 -1 4202560 2765 0 0 0 81 0 0 0 15 0 22 0 511248633 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 47850760870442 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=7986/tid=8017] ppid=7984 vsize=15685376 CPUtime=1.1 cores=0,2,4,6
/proc/7986/task/8017/stat : 8017 (java) R 7984 7986 7120 0 -1 4202560 12489 0 0 0 108 2 0 0 15 0 22 0 511248634 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 47850758076513 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=7986/tid=8018] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8018/stat : 8018 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 511248634 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8019] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8019/stat : 8019 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 511248634 16061825024 52801 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8028] ppid=7984 vsize=15685376 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8028/stat : 8028 (java) S 7984 7986 7120 0 -1 4202560 13 0 0 0 0 0 0 0 15 0 22 0 511248725 16061825024 52810 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8029] ppid=7984 vsize=15685376 CPUtime=0.07 cores=0,2,4,6
/proc/7986/task/8029/stat : 8029 (java) S 7984 7986 7120 0 -1 4202560 19 0 0 0 7 0 0 0 15 0 22 0 511248725 16061825024 52824 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=8030] ppid=7984 vsize=15685376 CPUtime=0.26 cores=0,2,4,6
/proc/7986/task/8030/stat : 8030 (java) R 7984 7986 7120 0 -1 4202560 3658 0 0 0 26 0 0 0 16 0 22 0 511248725 16061825024 52841 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912505978098 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=7986/tid=8031] ppid=7984 vsize=15685376 CPUtime=0.26 cores=0,2,4,6
/proc/7986/task/8031/stat : 8031 (java) R 7984 7986 7120 0 -1 4202560 2428 0 0 0 26 0 0 0 16 0 22 0 511248725 16061825024 52853 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912505366066 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.23
Current children cumulated vsize (KiB) 15685376

[startup+6.30107 s]
/proc/loadavg: 2.67 6.13 7.02 9/220 8035
/proc/meminfo: memFree=24019900/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15687184 CPUtime=17.09 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 185370 0 1 0 1681 28 0 0 23 0 22 0 511248628 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3921796 176201 2285 9 0 3912515 0
[pid=7986/tid=7988] ppid=7984 vsize=15687184 CPUtime=2.65 cores=0,2,4,6
/proc/7986/task/7988/stat : 7988 (java) S 7984 7986 7120 0 -1 4202560 35672 0 1 0 260 5 0 0 18 0 22 0 511248629 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7989] ppid=7984 vsize=15687184 CPUtime=0.01 cores=0,2,4,6
/proc/7986/task/7989/stat : 7989 (java) S 7984 7986 7120 0 -1 4202560 4857 0 0 0 1 0 0 0 16 0 22 0 511248630 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7990] ppid=7984 vsize=15687184 CPUtime=0.02 cores=0,2,4,6
/proc/7986/task/7990/stat : 7990 (java) S 7984 7986 7120 0 -1 4202560 8907 0 0 0 1 1 0 0 15 0 22 0 511248630 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7991] ppid=7984 vsize=15687184 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7991/stat : 7991 (java) S 7984 7986 7120 0 -1 4202560 490 0 0 0 0 0 0 0 15 0 22 0 511248630 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7992] ppid=7984 vsize=15687184 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7992/stat : 7992 (java) S 7984 7986 7120 0 -1 4202560 2754 0 0 0 0 0 0 0 15 0 22 0 511248630 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7993] ppid=7984 vsize=15687184 CPUtime=0.02 cores=0,2,4,6
/proc/7986/task/7993/stat : 7993 (java) S 7984 7986 7120 0 -1 4202560 9107 0 0 0 1 1 0 0 16 0 22 0 511248630 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7994] ppid=7984 vsize=15687184 CPUtime=0.04 cores=0,2,4,6
/proc/7986/task/7994/stat : 7994 (java) S 7984 7986 7120 0 -1 4202560 11714 0 0 0 2 2 0 0 16 0 22 0 511248630 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7995] ppid=7984 vsize=15687184 CPUtime=0.01 cores=0,2,4,6
/proc/7986/task/7995/stat : 7995 (java) S 7984 7986 7120 0 -1 4202560 2938 0 0 0 1 0 0 0 16 0 22 0 511248630 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7996] ppid=7984 vsize=15687184 CPUtime=0.02 cores=0,2,4,6
/proc/7986/task/7996/stat : 7996 (java) S 7984 7986 7120 0 -1 4202560 6551 0 0 0 1 1 0 0 15 0 22 0 511248630 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7998] ppid=7984 vsize=15687184 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7998/stat : 7998 (java) S 7984 7986 7120 0 -1 4202560 480 0 0 0 0 0 0 0 15 0 22 0 511248631 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 0 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7999] ppid=7984 vsize=15687184 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7999/stat : 7999 (java) S 7984 7986 7120 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 511248631 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8000] ppid=7984 vsize=15687184 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8000/stat : 8000 (java) S 7984 7986 7120 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 22 0 511248631 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8015] ppid=7984 vsize=15687184 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8015/stat : 8015 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 511248633 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522121137 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8016] ppid=7984 vsize=15687184 CPUtime=1.02 cores=0,2,4,6
/proc/7986/task/8016/stat : 8016 (java) S 7984 7986 7120 0 -1 4202560 3199 0 0 0 102 0 0 0 15 0 22 0 511248633 16063676416 176201 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=7986/tid=8029] ppid=7984 vsize=15686692 CPUtime=1105.54 cores=0,2,4,6
/proc/7986/task/8029/stat : 8029 (java) R 7984 7986 7120 0 -1 4202560 324996 0 0 0 110513 41 0 0 25 0 22 0 511248725 16063172608 236200 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912506190172 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=7986/tid=8030] ppid=7984 vsize=15686692 CPUtime=1105.42 cores=0,2,4,6
/proc/7986/task/8030/stat : 8030 (java) R 7984 7986 7120 0 -1 4202560 352076 0 0 0 110497 45 0 0 25 0 22 0 511248725 16063172608 236200 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912505604802 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=7986/tid=8031] ppid=7984 vsize=15686692 CPUtime=1107.3 cores=0,2,4,6
/proc/7986/task/8031/stat : 8031 (java) R 7984 7986 7120 0 -1 4202560 351796 0 0 0 110683 47 0 0 25 0 22 0 511248725 16063172608 236200 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912505978353 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4462.35
Current children cumulated vsize (KiB) 15686692

[startup+1182.3 s]
/proc/loadavg: 8.12 8.08 7.78 9/220 8066
/proc/meminfo: memFree=23415456/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15686692 CPUtime=4701.4 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 3345194 0 1 0 469502 638 0 0 23 0 22 0 511248628 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3921673 198771 2296 9 0 3912392 0
[pid=7986/tid=7988] ppid=7984 vsize=15686692 CPUtime=2.65 cores=0,2,4,6
/proc/7986/task/7988/stat : 7988 (java) S 7984 7986 7120 0 -1 4202560 35672 0 1 0 260 5 0 0 18 0 22 0 511248629 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7989] ppid=7984 vsize=15686692 CPUtime=4 cores=0,2,4,6
/proc/7986/task/7989/stat : 7989 (java) S 7984 7986 7120 0 -1 4202560 209351 0 0 0 359 41 0 0 15 0 22 0 511248630 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7990] ppid=7984 vsize=15686692 CPUtime=4.12 cores=0,2,4,6
/proc/7986/task/7990/stat : 7990 (java) S 7984 7986 7120 0 -1 4202560 227602 0 0 0 363 49 0 0 16 0 22 0 511248630 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7991] ppid=7984 vsize=15686692 CPUtime=4.1 cores=0,2,4,6
/proc/7986/task/7991/stat : 7991 (java) S 7984 7986 7120 0 -1 4202560 231078 0 0 0 364 46 0 0 15 0 22 0 511248630 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7992] ppid=7984 vsize=15686692 CPUtime=4.08 cores=0,2,4,6
/proc/7986/task/7992/stat : 7992 (java) S 7984 7986 7120 0 -1 4202560 233551 0 0 0 364 44 0 0 16 0 22 0 511248630 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7993] ppid=7984 vsize=15686692 CPUtime=3.93 cores=0,2,4,6
/proc/7986/task/7993/stat : 7993 (java) S 7984 7986 7120 0 -1 4202560 232830 0 0 0 350 43 0 0 16 0 22 0 511248630 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7994] ppid=7984 vsize=15686692 CPUtime=4.02 cores=0,2,4,6
/proc/7986/task/7994/stat : 7994 (java) S 7984 7986 7120 0 -1 4202560 246213 0 0 0 356 46 0 0 15 0 22 0 511248630 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7995] ppid=7984 vsize=15686692 CPUtime=4.06 cores=0,2,4,6
/proc/7986/task/7995/stat : 7995 (java) S 7984 7986 7120 0 -1 4202560 217667 0 0 0 362 44 0 0 16 0 22 0 511248630 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7996] ppid=7984 vsize=15686692 CPUtime=4.1 cores=0,2,4,6
/proc/7986/task/7996/stat : 7996 (java) S 7984 7986 7120 0 -1 4202560 236544 0 0 0 365 45 0 0 15 0 22 0 511248630 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7998] ppid=7984 vsize=15686692 CPUtime=2.52 cores=0,2,4,6
/proc/7986/task/7998/stat : 7998 (java) S 7984 7986 7120 0 -1 4202560 8970 0 0 0 177 75 0 0 16 0 22 0 511248631 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 0 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7999] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7999/stat : 7999 (java) S 7984 7986 7120 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 511248631 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8000] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8000/stat : 8000 (java) S 7984 7986 7120 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 22 0 511248631 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8015] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8015/stat : 8015 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 511248633 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522121137 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8016] ppid=7984 vsize=15686692 CPUtime=1.26 cores=0,2,4,6
/proc/7986/task/8016/stat : 8016 (java) S 7984 7986 7120 0 -1 4202560 4409 0 0 0 126 0 0 0 16 0 22 0 511248633 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8017] ppid=7984 vsize=15686692 CPUtime=1.41 cores=0,2,4,6
/proc/7986/task/8017/stat : 8017 (java) S 7984 7986 7120 0 -1 4202560 12517 0 0 0 139 2 0 0 15 0 22 0 511248634 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=8018] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8018/stat : 8018 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 511248634 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8019] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8019/stat : 8019 (java) S 7984 7986 7120 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 511248634 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8028] ppid=7984 vsize=15686692 CPUtime=1164.69 cores=0,2,4,6
/proc/7986/task/8028/stat : 8028 (java) R 7984 7986 7120 0 -1 4202560 362195 0 0 0 116418 51 0 0 25 0 22 0 511248725 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912506211742 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=7986/tid=8029] ppid=7984 vsize=15686692 CPUtime=1164.79 cores=0,2,4,6
/proc/7986/task/8029/stat : 8029 (java) R 7984 7986 7120 0 -1 4202560 345286 0 0 0 116437 42 0 0 25 0 22 0 511248725 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912506215569 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=7986/tid=8030] ppid=7984 vsize=15686692 CPUtime=1164.81 cores=0,2,4,6
/proc/7986/task/8030/stat : 8030 (java) R 7984 7986 7120 0 -1 4202560 370414 0 0 0 116434 47 0 0 25 0 22 0 511248725 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912506079342 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=7986/tid=8031] ppid=7984 vsize=15686692 CPUtime=1166.68 cores=0,2,4,6
/proc/7986/task/8031/stat : 8031 (java) R 7984 7986 7120 0 -1 4202560 369441 0 0 0 116619 49 0 0 25 0 22 0 511248725 16063172608 198771 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912505523469 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4701.4
Current children cumulated vsize (KiB) 15686692



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.1 s]
/proc/loadavg: 8.15 8.09 7.79 5/198 8070
/proc/meminfo: memFree=24192612/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15686692 CPUtime=4800.21 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 3431857 0 1 0 479368 653 0 0 23 0 22 0 511248628 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3921673 232994 2296 9 0 3912392 0
[pid=7986/tid=7988] ppid=7984 vsize=15686692 CPUtime=2.65 cores=0,2,4,6
/proc/7986/task/7988/stat : 7988 (java) S 7984 7986 7120 0 -1 4202560 35672 0 1 0 260 5 0 0 18 0 22 0 511248629 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7989] ppid=7984 vsize=15686692 CPUtime=4.09 cores=0,2,4,6
/proc/7986/task/7989/stat : 7989 (java) S 7984 7986 7120 0 -1 4202560 215076 0 0 0 367 42 0 0 16 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7990] ppid=7984 vsize=15686692 CPUtime=4.22 cores=0,2,4,6
/proc/7986/task/7990/stat : 7990 (java) S 7984 7986 7120 0 -1 4202560 235561 0 0 0 372 50 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7991] ppid=7984 vsize=15686692 CPUtime=4.18 cores=0,2,4,6
/proc/7986/task/7991/stat : 7991 (java) S 7984 7986 7120 0 -1 4202560 238137 0 0 0 370 48 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7992] ppid=7984 vsize=15686692 CPUtime=4.19 cores=0,2,4,6
/proc/7986/task/7992/stat : 7992 (java) S 7984 7986 7120 0 -1 4202560 240964 0 0 0 374 45 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7993] ppid=7984 vsize=15686692 CPUtime=4.01 cores=0,2,4,6
/proc/7986/task/7993/stat : 7993 (java) S 7984 7986 7120 0 -1 4202560 241590 0 0 0 357 44 0 0 16 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7994] ppid=7984 vsize=15686692 CPUtime=4.12 cores=0,2,4,6
/proc/7986/task/7994/stat : 7994 (java) S 7984 7986 7120 0 -1 4202560 253067 0 0 0 365 47 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7995] ppid=7984 vsize=15686692 CPUtime=4.14 cores=0,2,4,6
/proc/7986/task/7995/stat : 7995 (java) S 7984 7986 7120 0 -1 4202560 225527 0 0 0 368 46 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7996] ppid=7984 vsize=15686692 CPUtime=4.22 cores=0,2,4,6
/proc/7986/task/7996/stat : 7996 (java) S 7984 7986 7120 0 -1 4202560 244279 0 0 0 375 47 0 0 16 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7998] ppid=7984 vsize=15686692 CPUtime=2.57 cores=0,2,4,6
/proc/7986/task/7998/stat : 7998 (java) S 7984 7986 7120 0 -1 4202560 9216 0 0 0 181 76 0 0 16 0 22 0 511248631 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 0 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7999] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7999/stat : 7999 (java) S 7984 7986 7120 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 511248631 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8000] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8000/stat : 8000 (java) S 7984 7986 7120 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 22 0 511248631 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8015] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8015/stat : 8015 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 511248633 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522121137 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8016] ppid=7984 vsize=15686692 CPUtime=1.26 cores=0,2,4,6
/proc/7986/task/8016/stat : 8016 (java) S 7984 7986 7120 0 -1 4202560 4409 0 0 0 126 0 0 0 16 0 22 0 511248633 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8017] ppid=7984 vsize=15686692 CPUtime=1.41 cores=0,2,4,6
/proc/7986/task/8017/stat : 8017 (java) S 7984 7986 7120 0 -1 4202560 12517 0 0 0 139 2 0 0 15 0 22 0 511248634 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=8018] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8018/stat : 8018 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 511248634 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8019] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8019/stat : 8019 (java) S 7984 7986 7120 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 511248634 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8028] ppid=7984 vsize=15686692 CPUtime=1189.22 cores=0,2,4,6
/proc/7986/task/8028/stat : 8028 (java) R 7984 7986 7120 0 -1 4202560 370567 0 0 0 118871 51 0 0 25 0 22 0 511248725 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912505978080 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=7986/tid=8029] ppid=7984 vsize=15686692 CPUtime=1189.19 cores=0,2,4,6
/proc/7986/task/8029/stat : 8029 (java) R 7984 7986 7120 0 -1 4202560 351353 0 0 0 118876 43 0 0 25 0 22 0 511248725 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912506211742 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=7986/tid=8030] ppid=7984 vsize=15686692 CPUtime=1189.36 cores=0,2,4,6
/proc/7986/task/8030/stat : 8030 (java) R 7984 7986 7120 0 -1 4202560 377558 0 0 0 118887 49 0 0 25 0 22 0 511248725 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=7986/tid=8031] ppid=7984 vsize=15686692 CPUtime=1191.22 cores=0,2,4,6
/proc/7986/task/8031/stat : 8031 (java) R 7984 7986 7120 0 -1 4202560 374908 0 0 0 119072 50 0 0 25 0 22 0 511248725 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912506215538 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 15686692

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.1 s]
/proc/loadavg: 8.15 8.09 7.79 5/198 8070
/proc/meminfo: memFree=24192612/32951124 swapFree=67111524/67111528
[pid=7986] ppid=7984 vsize=15686692 CPUtime=4800.21 cores=0,2,4,6
/proc/7986/stat : 7986 (java) S 7984 7986 7120 0 -1 4202496 3431857 0 1 0 479368 653 0 0 23 0 22 0 511248628 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/7986/statm: 3921673 232994 2296 9 0 3912392 0
[pid=7986/tid=7988] ppid=7984 vsize=15686692 CPUtime=2.65 cores=0,2,4,6
/proc/7986/task/7988/stat : 7988 (java) S 7984 7986 7120 0 -1 4202560 35672 0 1 0 260 5 0 0 18 0 22 0 511248629 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7989] ppid=7984 vsize=15686692 CPUtime=4.09 cores=0,2,4,6
/proc/7986/task/7989/stat : 7989 (java) S 7984 7986 7120 0 -1 4202560 215076 0 0 0 367 42 0 0 16 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7990] ppid=7984 vsize=15686692 CPUtime=4.22 cores=0,2,4,6
/proc/7986/task/7990/stat : 7990 (java) S 7984 7986 7120 0 -1 4202560 235561 0 0 0 372 50 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7991] ppid=7984 vsize=15686692 CPUtime=4.18 cores=0,2,4,6
/proc/7986/task/7991/stat : 7991 (java) S 7984 7986 7120 0 -1 4202560 238137 0 0 0 370 48 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 0 0 0 0
[pid=7986/tid=7992] ppid=7984 vsize=15686692 CPUtime=4.19 cores=0,2,4,6
/proc/7986/task/7992/stat : 7992 (java) S 7984 7986 7120 0 -1 4202560 240964 0 0 0 374 45 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7993] ppid=7984 vsize=15686692 CPUtime=4.01 cores=0,2,4,6
/proc/7986/task/7993/stat : 7993 (java) S 7984 7986 7120 0 -1 4202560 241590 0 0 0 357 44 0 0 16 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7994] ppid=7984 vsize=15686692 CPUtime=4.12 cores=0,2,4,6
/proc/7986/task/7994/stat : 7994 (java) S 7984 7986 7120 0 -1 4202560 253067 0 0 0 365 47 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 4 0 0 0
[pid=7986/tid=7995] ppid=7984 vsize=15686692 CPUtime=4.14 cores=0,2,4,6
/proc/7986/task/7995/stat : 7995 (java) S 7984 7986 7120 0 -1 4202560 225527 0 0 0 368 46 0 0 15 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7996] ppid=7984 vsize=15686692 CPUtime=4.22 cores=0,2,4,6
/proc/7986/task/7996/stat : 7996 (java) S 7984 7986 7120 0 -1 4202560 244279 0 0 0 375 47 0 0 16 0 22 0 511248630 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=7998] ppid=7984 vsize=15686692 CPUtime=2.57 cores=0,2,4,6
/proc/7986/task/7998/stat : 7998 (java) S 7984 7986 7120 0 -1 4202560 9216 0 0 0 181 76 0 0 16 0 22 0 511248631 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 0 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=7999] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/7999/stat : 7999 (java) S 7984 7986 7120 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 511248631 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8000] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8000/stat : 8000 (java) S 7984 7986 7120 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 22 0 511248631 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8015] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8015/stat : 8015 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 511248633 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522121137 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8016] ppid=7984 vsize=15686692 CPUtime=1.26 cores=0,2,4,6
/proc/7986/task/8016/stat : 8016 (java) S 7984 7986 7120 0 -1 4202560 4409 0 0 0 126 0 0 0 16 0 22 0 511248633 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8017] ppid=7984 vsize=15686692 CPUtime=1.41 cores=0,2,4,6
/proc/7986/task/8017/stat : 8017 (java) S 7984 7986 7120 0 -1 4202560 12517 0 0 0 139 2 0 0 15 0 22 0 511248634 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 6 0 0 0
[pid=7986/tid=8018] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8018/stat : 8018 (java) S 7984 7986 7120 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 511248634 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8019] ppid=7984 vsize=15686692 CPUtime=0 cores=0,2,4,6
/proc/7986/task/8019/stat : 8019 (java) S 7984 7986 7120 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 511248634 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522114048 0 4 0 16800975 18446604453942101888 0 0 -1 2 0 0 0
[pid=7986/tid=8028] ppid=7984 vsize=15686692 CPUtime=1189.22 cores=0,2,4,6
/proc/7986/task/8028/stat : 8028 (java) R 7984 7986 7120 0 -1 4202560 370567 0 0 0 118871 51 0 0 25 0 22 0 511248725 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912505978080 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=7986/tid=8029] ppid=7984 vsize=15686692 CPUtime=1189.19 cores=0,2,4,6
/proc/7986/task/8029/stat : 8029 (java) R 7984 7986 7120 0 -1 4202560 351353 0 0 0 118876 43 0 0 25 0 22 0 511248725 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912506211742 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=7986/tid=8030] ppid=7984 vsize=15686692 CPUtime=1189.36 cores=0,2,4,6
/proc/7986/task/8030/stat : 8030 (java) R 7984 7986 7120 0 -1 4202560 377558 0 0 0 118887 49 0 0 25 0 22 0 511248725 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 233522113433 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=7986/tid=8031] ppid=7984 vsize=15686692 CPUtime=1191.22 cores=0,2,4,6
/proc/7986/task/8031/stat : 8031 (java) R 7984 7986 7120 0 -1 4202560 374908 0 0 0 119072 50 0 0 25 0 22 0 511248725 16063172608 232994 33554432000 1073741824 1073778376 140736275856480 18446744073709551615 46912506215538 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 15686692

Child status: 143
Real time (s): 1207.16
CPU time (s): 4800.29
CPU user time (s): 4793.71
CPU system time (s): 6.583
CPU usage (%): 397.652
Max. virtual memory (cumulated for all children) (KiB): 15693328

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4793.71
system time used= 6.583
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3431884
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 96839
involuntary context switches= 73881

runsolver used 1.9967 second user time and 4.66929 second system time

The end

Launcher Data 

Begin job on node145 at 2011-04-30 20:32:08
IDJOB=3312068
IDBENCH=85987
IDSOLVER=1698
FILE ID=node145/3312068-1304188328
RUNJOBID= node145-1304188328-7972
PBS_JOBID= 13172456
Free space on /tmp= 73024 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT05/industrial/grieu05/vmpc/vmpc_35.renamed-as.sat05-1921.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312068-1304188328/watcher-3312068-1304188328 -o /tmp/evaluation-result-3312068-1304188328/solver-3312068-1304188328 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312068-1304188328.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5fda0e0fb8a21967728dfe29bf2d4ea5
RANDOM SEED=1702314014

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25121452 kB
Buffers:       1297896 kB
Cached:        5935652 kB
SwapCached:          4 kB
Active:         902536 kB
Inactive:      6398348 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25121452 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            7536 kB
Writeback:           0 kB
AnonPages:       67364 kB
Mapped:          14488 kB
Slab:           466144 kB
PageTables:       4692 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187420 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73020 MiB
End job on node145 at 2011-04-30 20:52:17