Trace number 3312396

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.37 1206.74

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S317257086-003-UNKNOWN.cnf
MD5SUM6f9c7c042784ec486e9e8bc570309805
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.10/0.11	42:40 INFO : Reading from input HOME/instance-3312396-1304113360.cnf
0.62/0.45	Executor set job limit to 1000000
0.62/0.45	Executor set job limit to 1000000
0.62/0.45	Executor set job limit to 1000000
0.62/0.45	Executor set job limit to 1000000
0.62/0.45	Starting Executor!
0.62/0.45	Starting Executor!
0.62/0.45	Starting Executor!
0.62/0.45	Starting Executor!
1.82/0.92	42:41 INFO : 250 variables remaining out of 250
1.82/0.92	42:41 INFO : 170000 literals remaining out of 170000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312396-1304113360/watcher-3312396-1304113360 -o /tmp/evaluation-result-3312396-1304113360/solver-3312396-1304113360 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312396-1304113360.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.87 8.08 8.01 5/198 28657
/proc/meminfo: memFree=21059012/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=28384 CPUtime=0 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 1424 0 0 0 0 0 0 0 25 0 2 0 522936934 29065216 894 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 7096 898 686 9 0 381 0
[pid=28657/tid=28658] ppid=28655 vsize=30580 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) R 28655 28657 28325 0 -1 4202560 94 0 0 0 0 0 0 0 25 0 2 0 522936935 31313920 920 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270608148224 0 0 4096 0 0 0 0 -1 5 0 0 0

[startup+0.069063 s]
/proc/loadavg: 7.87 8.08 8.01 5/198 28657
/proc/meminfo: memFree=21059012/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15609780 CPUtime=0.05 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 4417 0 1 0 5 0 0 0 25 0 18 0 522936934 15984414720 3856 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3902445 3856 1779 9 0 3893164 0
[pid=28657/tid=28658] ppid=28655 vsize=15609780 CPUtime=0.05 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) R 28655 28657 28325 0 -1 4202560 2998 0 1 0 5 0 0 0 25 0 18 0 522936935 15984414720 3856 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270613106693 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 15609780

[startup+0.101067 s]
/proc/loadavg: 7.87 8.08 8.01 5/198 28657
/proc/meminfo: memFree=21059012/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15676844 CPUtime=0.1 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 5617 0 1 0 9 1 0 0 25 0 18 0 522936934 16053088256 5026 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3919211 5027 2118 9 0 3909930 0
[pid=28657/tid=28658] ppid=28655 vsize=15676844 CPUtime=0.08 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) R 28655 28657 28325 0 -1 4202560 3481 0 1 0 7 1 0 0 18 0 18 0 522936935 16053088256 5027 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46929191290899 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676844

[startup+0.301024 s]
/proc/loadavg: 7.87 8.08 8.01 5/198 28657
/proc/meminfo: memFree=21059012/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15680180 CPUtime=0.52 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 15952 0 1 0 49 3 0 0 25 0 18 0 522936934 16056504320 14373 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3920045 14380 2207 9 0 3910764 0
[pid=28657/tid=28658] ppid=28655 vsize=15680180 CPUtime=0.28 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) R 28655 28657 28325 0 -1 4202560 10869 0 1 0 26 2 0 0 18 0 18 0 522936935 16056504320 14384 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505582258 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15680180

[startup+0.700947 s]
/proc/loadavg: 7.87 8.08 8.01 5/198 28657
/proc/meminfo: memFree=21059012/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15700276 CPUtime=1.22 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 46029 0 1 0 115 7 0 0 25 0 22 0 522936934 16077082624 42428 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3925069 42428 2248 9 0 3915788 0
[pid=28657/tid=28658] ppid=28655 vsize=15700276 CPUtime=0.68 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) R 28655 28657 28325 0 -1 4202560 34084 0 1 0 63 5 0 0 20 0 22 0 522936935 16077082624 42428 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 18446744073699065863 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 15700276

[startup+1.50077 s]
/proc/loadavg: 7.87 8.08 8.01 8/220 28679
/proc/meminfo: memFree=20878416/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15714564 CPUtime=3.64 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 59189 0 1 0 355 9 0 0 25 0 22 0 522936934 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3928641 52600 2274 9 0 3919360 0
[pid=28657/tid=28658] ppid=28655 vsize=15714564 CPUtime=0.91 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) S 28655 28657 28325 0 -1 4202560 34130 0 1 0 86 5 0 0 20 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28660] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28660/stat : 28660 (java) S 28655 28657 28325 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28661] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28661/stat : 28661 (java) R 28655 28657 28325 0 -1 4202560 1098 0 0 0 0 0 0 0 18 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28657/tid=28662] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28662/stat : 28662 (java) S 28655 28657 28325 0 -1 4202560 1468 0 0 0 0 0 0 0 18 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28663] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28663/stat : 28663 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28664] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28664/stat : 28664 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28665] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28665/stat : 28665 (java) S 28655 28657 28325 0 -1 4202560 871 0 0 0 0 0 0 0 18 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28666] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28666/stat : 28666 (java) S 28655 28657 28325 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28667] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28667/stat : 28667 (java) S 28655 28657 28325 0 -1 4202560 593 0 0 0 0 0 0 0 18 0 22 0 522936935 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28668] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28668/stat : 28668 (java) S 28655 28657 28325 0 -1 4202560 10 0 0 0 0 0 0 0 16 0 22 0 522936936 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 0 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28669] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28669/stat : 28669 (java) S 28655 28657 28325 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28670] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28670/stat : 28670 (java) S 28655 28657 28325 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28671] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28671/stat : 28671 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624934321 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28672] ppid=28655 vsize=15714564 CPUtime=0.71 cores=1,3,5,7
/proc/28657/task/28672/stat : 28672 (java) R 28655 28657 28325 0 -1 4202560 11770 0 0 0 70 1 0 0 23 0 22 0 522936938 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624936629 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28657/tid=28673] ppid=28655 vsize=15714564 CPUtime=0.71 cores=1,3,5,7
/proc/28657/task/28673/stat : 28673 (java) R 28655 28657 28325 0 -1 4202560 6414 0 0 0 71 0 0 0 15 0 22 0 522936938 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46929188888027 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28657/tid=28674] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28674/stat : 28674 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28675] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28675/stat : 28675 (java) R 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522936938 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28657/tid=28676] ppid=28655 vsize=15714564 CPUtime=0.36 cores=1,3,5,7
/proc/28657/task/28676/stat : 28676 (java) R 28655 28657 28325 0 -1 4202560 158 0 0 0 36 0 0 0 16 0 22 0 522936980 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505799461 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28657/tid=28677] ppid=28655 vsize=15714564 CPUtime=0.4 cores=1,3,5,7
/proc/28657/task/28677/stat : 28677 (java) R 28655 28657 28325 0 -1 4202560 202 0 0 0 40 0 0 0 16 0 22 0 522936980 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505799461 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=28657/tid=28678] ppid=28655 vsize=15714564 CPUtime=0.25 cores=1,3,5,7
/proc/28657/task/28678/stat : 28678 (java) R 28655 28657 28325 0 -1 4202560 11 0 0 0 25 0 0 0 16 0 22 0 522936980 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505848103 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28657/tid=28679] ppid=28655 vsize=15714564 CPUtime=0.22 cores=1,3,5,7
/proc/28657/task/28679/stat : 28679 (java) R 28655 28657 28325 0 -1 4202560 160 0 0 0 22 0 0 0 16 0 22 0 522936980 16091713536 52600 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.64
Current children cumulated vsize (KiB) 15714564

[startup+3.10149 s]
/proc/loadavg: 7.87 8.08 8.01 10/220 28679
/proc/meminfo: memFree=20849896/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15714564 CPUtime=10.01 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 98180 0 1 0 986 15 0 0 25 0 22 0 522936934 16091713536 91389 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3928641 91398 2274 9 0 3919360 0
[pid=28657/tid=28658] ppid=28655 vsize=15714564 CPUtime=0.91 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) S 28655 28657 28325 0 -1 4202560 34130 0 1 0 86 5 0 0 20 0 22 0 522936935 16091713536 91399 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28660] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28660/stat : 28660 (java) S 28655 28657 28325 0 -1 4202560 3835 0 0 0 0 0 0 0 15 0 22 0 522936935 16091713536 91408 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28661] ppid=28655 vsize=15714564 CPUtime=0.01 cores=1,3,5,7
/proc/28657/task/28661/stat : 28661 (java) S 28655 28657 28325 0 -1 4202560 4370 0 0 0 1 0 0 0 16 0 22 0 522936935 16091713536 91408 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28662] ppid=28655 vsize=15714564 CPUtime=0.02 cores=1,3,5,7
/proc/28657/task/28662/stat : 28662 (java) S 28655 28657 28325 0 -1 4202560 4864 0 0 0 1 1 0 0 16 0 22 0 522936935 16091713536 91408 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28663] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28663/stat : 28663 (java) S 28655 28657 28325 0 -1 4202560 2240 0 0 0 0 0 0 0 15 0 22 0 522936935 16091713536 91408 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28664] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28664/stat : 28664 (java) S 28655 28657 28325 0 -1 4202560 4638 0 0 0 0 0 0 0 16 0 22 0 522936935 16091713536 91413 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28665] ppid=28655 vsize=15714564 CPUtime=0.01 cores=1,3,5,7
/proc/28657/task/28665/stat : 28665 (java) S 28655 28657 28325 0 -1 4202560 6132 0 0 0 1 0 0 0 16 0 22 0 522936935 16091713536 91413 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28666] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28666/stat : 28666 (java) S 28655 28657 28325 0 -1 4202560 20 0 0 0 0 0 0 0 15 0 22 0 522936935 16091713536 91422 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28667] ppid=28655 vsize=15714564 CPUtime=0.01 cores=1,3,5,7
/proc/28657/task/28667/stat : 28667 (java) S 28655 28657 28325 0 -1 4202560 3394 0 0 0 1 0 0 0 15 0 22 0 522936935 16091713536 91433 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28668] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28668/stat : 28668 (java) S 28655 28657 28325 0 -1 4202560 106 0 0 0 0 0 0 0 15 0 22 0 522936936 16091713536 91433 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 0 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28669] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28669/stat : 28669 (java) S 28655 28657 28325 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 91433 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28670] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28670/stat : 28670 (java) S 28655 28657 28325 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 91434 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28671] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28671/stat : 28671 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 91435 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624934321 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28672] ppid=28655 vsize=15714564 CPUtime=0.71 cores=1,3,5,7
/proc/28657/task/28672/stat : 28672 (java) R 28655 28657 28325 0 -1 4202560 11773 0 0 0 70 1 0 0 22 0 22 0 522936938 16091713536 91435 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46929193367712 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28657/tid=28673] ppid=28655 vsize=15714564 CPUtime=0.85 cores=1,3,5,7
/proc/28657/task/28673/stat : 28673 (java) S 28655 28657 28325 0 -1 4202560 6434 0 0 0 85 0 0 0 15 0 22 0 522936938 16091713536 91435 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28674] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28674/stat : 28674 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 91435 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28675] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28675/stat : 28675 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522936938 16091713536 91445 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28676] ppid=28655 vsize=15714564 CPUtime=1.92 cores=1,3,5,7
/proc/28657/task/28676/stat : 28676 (java) R 28655 28657 28325 0 -1 4202560 3501 0 0 0 192 0 0 0 17 0 22 0 522936980 16091713536 91445 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46929192712230 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28657/tid=28677] ppid=28655 vsize=15714564 CPUtime=1.9 cores=1,3,5,7
/proc/28657/task/28677/stat : 28677 (java) R 28655 28657 28325 0 -1 4202560 3761 0 0 0 190 0 0 0 17 0 22 0 522936980 16091713536 91445 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505925247 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=28657/tid=28678] ppid=28655 vsize=15714564 CPUtime=1.81 cores=1,3,5,7
/proc/28657/task/28678/stat : 28678 (java) R 28655 28657 28325 0 -1 4202560 3391 0 0 0 181 0 0 0 17 0 22 0 522936980 16091713536 91445 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505523231 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28657/tid=28679] ppid=28655 vsize=15714564 CPUtime=1.7 cores=1,3,5,7
/proc/28657/task/28679/stat : 28679 (java) R 28655 28657 28325 0 -1 4202560 4265 0 0 0 170 0 0 0 17 0 22 0 522936980 16091713536 91449 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505764093 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 10.01
Current children cumulated vsize (KiB) 15714564

[startup+6.30092 s]
/proc/loadavg: 8.04 8.11 8.02 9/220 28679
/proc/meminfo: memFree=20308912/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15714564 CPUtime=22.78 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 217095 0 1 0 2243 35 0 0 25 0 22 0 522936934 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3928641 209772 2284 9 0 3919360 0
[pid=28657/tid=28658] ppid=28655 vsize=15714564 CPUtime=0.91 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) S 28655 28657 28325 0 -1 4202560 34130 0 1 0 86 5 0 0 20 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28660] ppid=28655 vsize=15714564 CPUtime=0.06 cores=1,3,5,7
/proc/28657/task/28660/stat : 28660 (java) S 28655 28657 28325 0 -1 4202560 17146 0 0 0 3 3 0 0 16 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28661] ppid=28655 vsize=15714564 CPUtime=0.01 cores=1,3,5,7
/proc/28657/task/28661/stat : 28661 (java) S 28655 28657 28325 0 -1 4202560 4370 0 0 0 1 0 0 0 15 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28662] ppid=28655 vsize=15714564 CPUtime=0.07 cores=1,3,5,7
/proc/28657/task/28662/stat : 28662 (java) S 28655 28657 28325 0 -1 4202560 21846 0 0 0 3 4 0 0 16 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28663] ppid=28655 vsize=15714564 CPUtime=0.04 cores=1,3,5,7
/proc/28657/task/28663/stat : 28663 (java) S 28655 28657 28325 0 -1 4202560 13941 0 0 0 2 2 0 0 16 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28664] ppid=28655 vsize=15714564 CPUtime=0.04 cores=1,3,5,7
/proc/28657/task/28664/stat : 28664 (java) S 28655 28657 28325 0 -1 4202560 13180 0 0 0 2 2 0 0 16 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28665] ppid=28655 vsize=15714564 CPUtime=0.03 cores=1,3,5,7
/proc/28657/task/28665/stat : 28665 (java) S 28655 28657 28325 0 -1 4202560 11151 0 0 0 2 1 0 0 15 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28666] ppid=28655 vsize=15714564 CPUtime=0.02 cores=1,3,5,7
/proc/28657/task/28666/stat : 28666 (java) S 28655 28657 28325 0 -1 4202560 8808 0 0 0 1 1 0 0 15 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28667] ppid=28655 vsize=15714564 CPUtime=0.02 cores=1,3,5,7
/proc/28657/task/28667/stat : 28667 (java) S 28655 28657 28325 0 -1 4202560 6765 0 0 0 1 1 0 0 15 0 22 0 522936935 16091713536 209772 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=28657/tid=28677] ppid=28655 vsize=15714564 CPUtime=1107.53 cores=1,3,5,7
/proc/28657/task/28677/stat : 28677 (java) R 28655 28657 28325 0 -1 4202560 225832 0 0 0 110718 35 0 0 25 0 22 0 522936980 16091713536 116682 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28657/tid=28678] ppid=28655 vsize=15714564 CPUtime=1108.07 cores=1,3,5,7
/proc/28657/task/28678/stat : 28678 (java) R 28655 28657 28325 0 -1 4202560 229880 0 0 0 110772 35 0 0 25 0 22 0 522936980 16091713536 116682 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912506156361 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28657/tid=28679] ppid=28655 vsize=15714564 CPUtime=1107.52 cores=1,3,5,7
/proc/28657/task/28679/stat : 28679 (java) R 28655 28657 28325 0 -1 4202560 226565 0 0 0 110717 35 0 0 25 0 22 0 522936980 16091713536 116682 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505860911 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4464.49
Current children cumulated vsize (KiB) 15714564

[startup+1182.3 s]
/proc/loadavg: 7.27 7.89 7.95 5/193 28739
/proc/meminfo: memFree=22437968/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15714564 CPUtime=4703.21 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 1819803 0 1 0 469924 397 0 0 25 0 22 0 522936934 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3928641 118581 2299 9 0 3919360 0
[pid=28657/tid=28658] ppid=28655 vsize=15714564 CPUtime=0.91 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) S 28655 28657 28325 0 -1 4202560 34130 0 1 0 86 5 0 0 20 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28660] ppid=28655 vsize=15714564 CPUtime=3.73 cores=1,3,5,7
/proc/28657/task/28660/stat : 28660 (java) S 28655 28657 28325 0 -1 4202560 103949 0 0 0 350 23 0 0 15 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28661] ppid=28655 vsize=15714564 CPUtime=3.74 cores=1,3,5,7
/proc/28657/task/28661/stat : 28661 (java) S 28655 28657 28325 0 -1 4202560 92815 0 0 0 353 21 0 0 15 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28662] ppid=28655 vsize=15714564 CPUtime=3.68 cores=1,3,5,7
/proc/28657/task/28662/stat : 28662 (java) S 28655 28657 28325 0 -1 4202560 111095 0 0 0 342 26 0 0 15 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28663] ppid=28655 vsize=15714564 CPUtime=3.66 cores=1,3,5,7
/proc/28657/task/28663/stat : 28663 (java) S 28655 28657 28325 0 -1 4202560 100041 0 0 0 344 22 0 0 16 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28664] ppid=28655 vsize=15714564 CPUtime=3.62 cores=1,3,5,7
/proc/28657/task/28664/stat : 28664 (java) S 28655 28657 28325 0 -1 4202560 98232 0 0 0 341 21 0 0 15 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28665] ppid=28655 vsize=15714564 CPUtime=3.68 cores=1,3,5,7
/proc/28657/task/28665/stat : 28665 (java) S 28655 28657 28325 0 -1 4202560 100274 0 0 0 346 22 0 0 16 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28666] ppid=28655 vsize=15714564 CPUtime=3.81 cores=1,3,5,7
/proc/28657/task/28666/stat : 28666 (java) S 28655 28657 28325 0 -1 4202560 97150 0 0 0 360 21 0 0 15 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28667] ppid=28655 vsize=15714564 CPUtime=3.64 cores=1,3,5,7
/proc/28657/task/28667/stat : 28667 (java) S 28655 28657 28325 0 -1 4202560 95942 0 0 0 343 21 0 0 15 0 22 0 522936935 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28668] ppid=28655 vsize=15714564 CPUtime=1.74 cores=1,3,5,7
/proc/28657/task/28668/stat : 28668 (java) S 28655 28657 28325 0 -1 4202560 4876 0 0 0 115 59 0 0 15 0 22 0 522936936 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 0 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28669] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28669/stat : 28669 (java) S 28655 28657 28325 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28670] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28670/stat : 28670 (java) S 28655 28657 28325 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28671] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28671/stat : 28671 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624934321 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28672] ppid=28655 vsize=15714564 CPUtime=0.98 cores=1,3,5,7
/proc/28657/task/28672/stat : 28672 (java) S 28655 28657 28325 0 -1 4202560 11804 0 0 0 97 1 0 0 15 0 22 0 522936938 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28673] ppid=28655 vsize=15714564 CPUtime=1.2 cores=1,3,5,7
/proc/28657/task/28673/stat : 28673 (java) S 28655 28657 28325 0 -1 4202560 6502 0 0 0 119 1 0 0 15 0 22 0 522936938 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28674] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28674/stat : 28674 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28675] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28675/stat : 28675 (java) S 28655 28657 28325 0 -1 4202560 63 0 0 0 0 0 0 0 15 0 22 0 522936938 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28676] ppid=28655 vsize=15714564 CPUtime=1167.73 cores=1,3,5,7
/proc/28657/task/28676/stat : 28676 (java) R 28655 28657 28325 0 -1 4202560 243149 0 0 0 116737 36 0 0 25 0 22 0 522936980 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505848051 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28657/tid=28677] ppid=28655 vsize=15714564 CPUtime=1166.79 cores=1,3,5,7
/proc/28657/task/28677/stat : 28677 (java) R 28655 28657 28325 0 -1 4202560 237832 0 0 0 116643 36 0 0 25 0 22 0 522936980 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505366066 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=28657/tid=28678] ppid=28655 vsize=15714564 CPUtime=1167.42 cores=1,3,5,7
/proc/28657/task/28678/stat : 28678 (java) R 28655 28657 28325 0 -1 4202560 242076 0 0 0 116706 36 0 0 20 0 22 0 522936980 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505848084 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28657/tid=28679] ppid=28655 vsize=15714564 CPUtime=1166.7 cores=1,3,5,7
/proc/28657/task/28679/stat : 28679 (java) R 28655 28657 28325 0 -1 4202560 238488 0 0 0 116633 37 0 0 25 0 22 0 522936980 16091713536 118581 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505880235 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4703.21
Current children cumulated vsize (KiB) 15714564



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.71 s]
/proc/loadavg: 6.16 7.58 7.85 5/193 28740
/proc/meminfo: memFree=22497476/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15714564 CPUtime=4800.32 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 1843054 0 1 0 479626 406 0 0 25 0 22 0 522936934 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3928641 105172 2299 9 0 3919360 0
[pid=28657/tid=28658] ppid=28655 vsize=15714564 CPUtime=0.91 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) S 28655 28657 28325 0 -1 4202560 34130 0 1 0 86 5 0 0 20 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28660] ppid=28655 vsize=15714564 CPUtime=3.81 cores=1,3,5,7
/proc/28657/task/28660/stat : 28660 (java) S 28655 28657 28325 0 -1 4202560 106085 0 0 0 357 24 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28661] ppid=28655 vsize=15714564 CPUtime=3.82 cores=1,3,5,7
/proc/28657/task/28661/stat : 28661 (java) S 28655 28657 28325 0 -1 4202560 95129 0 0 0 360 22 0 0 16 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28662] ppid=28655 vsize=15714564 CPUtime=3.75 cores=1,3,5,7
/proc/28657/task/28662/stat : 28662 (java) S 28655 28657 28325 0 -1 4202560 113131 0 0 0 349 26 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28663] ppid=28655 vsize=15714564 CPUtime=3.76 cores=1,3,5,7
/proc/28657/task/28663/stat : 28663 (java) S 28655 28657 28325 0 -1 4202560 103144 0 0 0 353 23 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28664] ppid=28655 vsize=15714564 CPUtime=3.7 cores=1,3,5,7
/proc/28657/task/28664/stat : 28664 (java) S 28655 28657 28325 0 -1 4202560 100519 0 0 0 348 22 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28665] ppid=28655 vsize=15714564 CPUtime=3.76 cores=1,3,5,7
/proc/28657/task/28665/stat : 28665 (java) S 28655 28657 28325 0 -1 4202560 102236 0 0 0 354 22 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28666] ppid=28655 vsize=15714564 CPUtime=3.9 cores=1,3,5,7
/proc/28657/task/28666/stat : 28666 (java) S 28655 28657 28325 0 -1 4202560 99512 0 0 0 368 22 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28667] ppid=28655 vsize=15714564 CPUtime=3.69 cores=1,3,5,7
/proc/28657/task/28667/stat : 28667 (java) S 28655 28657 28325 0 -1 4202560 97887 0 0 0 348 21 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28668] ppid=28655 vsize=15714564 CPUtime=1.8 cores=1,3,5,7
/proc/28657/task/28668/stat : 28668 (java) S 28655 28657 28325 0 -1 4202560 4961 0 0 0 119 61 0 0 15 0 22 0 522936936 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 0 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28669] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28669/stat : 28669 (java) S 28655 28657 28325 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28670] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28670/stat : 28670 (java) S 28655 28657 28325 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28671] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28671/stat : 28671 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624934321 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28672] ppid=28655 vsize=15714564 CPUtime=0.98 cores=1,3,5,7
/proc/28657/task/28672/stat : 28672 (java) S 28655 28657 28325 0 -1 4202560 11804 0 0 0 97 1 0 0 15 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28673] ppid=28655 vsize=15714564 CPUtime=1.2 cores=1,3,5,7
/proc/28657/task/28673/stat : 28673 (java) S 28655 28657 28325 0 -1 4202560 6502 0 0 0 119 1 0 0 15 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28674] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28674/stat : 28674 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28675] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28675/stat : 28675 (java) R 28655 28657 28325 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28657/tid=28676] ppid=28655 vsize=15714564 CPUtime=1191.87 cores=1,3,5,7
/proc/28657/task/28676/stat : 28676 (java) R 28655 28657 28325 0 -1 4202560 244267 0 0 0 119150 37 0 0 25 0 22 0 522936980 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912506156294 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=28657/tid=28677] ppid=28655 vsize=15714564 CPUtime=1190.89 cores=1,3,5,7
/proc/28657/task/28677/stat : 28677 (java) R 28655 28657 28325 0 -1 4202560 239060 0 0 0 119052 37 0 0 25 0 22 0 522936980 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505847975 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28657/tid=28678] ppid=28655 vsize=15714564 CPUtime=1191.57 cores=1,3,5,7
/proc/28657/task/28678/stat : 28678 (java) R 28655 28657 28325 0 -1 4202560 243402 0 0 0 119120 37 0 0 25 0 22 0 522936980 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505870687 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28657/tid=28679] ppid=28655 vsize=15714564 CPUtime=1190.75 cores=1,3,5,7
/proc/28657/task/28679/stat : 28679 (java) R 28655 28657 28325 0 -1 4202560 239835 0 0 0 119037 38 0 0 25 0 22 0 522936980 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912506156361 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 15714564

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1206.71 s]
/proc/loadavg: 6.16 7.58 7.85 5/193 28740
/proc/meminfo: memFree=22497476/32951124 swapFree=67111524/67111528
[pid=28657] ppid=28655 vsize=15714564 CPUtime=4800.32 cores=1,3,5,7
/proc/28657/stat : 28657 (java) S 28655 28657 28325 0 -1 4202496 1843054 0 1 0 479626 406 0 0 25 0 22 0 522936934 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624913381 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28657/statm: 3928641 105172 2299 9 0 3919360 0
[pid=28657/tid=28658] ppid=28655 vsize=15714564 CPUtime=0.91 cores=1,3,5,7
/proc/28657/task/28658/stat : 28658 (java) S 28655 28657 28325 0 -1 4202560 34130 0 1 0 86 5 0 0 20 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28660] ppid=28655 vsize=15714564 CPUtime=3.81 cores=1,3,5,7
/proc/28657/task/28660/stat : 28660 (java) S 28655 28657 28325 0 -1 4202560 106085 0 0 0 357 24 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28661] ppid=28655 vsize=15714564 CPUtime=3.82 cores=1,3,5,7
/proc/28657/task/28661/stat : 28661 (java) S 28655 28657 28325 0 -1 4202560 95129 0 0 0 360 22 0 0 16 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28662] ppid=28655 vsize=15714564 CPUtime=3.75 cores=1,3,5,7
/proc/28657/task/28662/stat : 28662 (java) S 28655 28657 28325 0 -1 4202560 113131 0 0 0 349 26 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28663] ppid=28655 vsize=15714564 CPUtime=3.76 cores=1,3,5,7
/proc/28657/task/28663/stat : 28663 (java) S 28655 28657 28325 0 -1 4202560 103144 0 0 0 353 23 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28664] ppid=28655 vsize=15714564 CPUtime=3.7 cores=1,3,5,7
/proc/28657/task/28664/stat : 28664 (java) S 28655 28657 28325 0 -1 4202560 100519 0 0 0 348 22 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28665] ppid=28655 vsize=15714564 CPUtime=3.76 cores=1,3,5,7
/proc/28657/task/28665/stat : 28665 (java) S 28655 28657 28325 0 -1 4202560 102236 0 0 0 354 22 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28666] ppid=28655 vsize=15714564 CPUtime=3.9 cores=1,3,5,7
/proc/28657/task/28666/stat : 28666 (java) S 28655 28657 28325 0 -1 4202560 99512 0 0 0 368 22 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28667] ppid=28655 vsize=15714564 CPUtime=3.69 cores=1,3,5,7
/proc/28657/task/28667/stat : 28667 (java) S 28655 28657 28325 0 -1 4202560 97887 0 0 0 348 21 0 0 15 0 22 0 522936935 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28668] ppid=28655 vsize=15714564 CPUtime=1.8 cores=1,3,5,7
/proc/28657/task/28668/stat : 28668 (java) S 28655 28657 28325 0 -1 4202560 4961 0 0 0 119 61 0 0 15 0 22 0 522936936 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 0 0 16800975 18446604464474151936 0 0 -1 1 0 0 0
[pid=28657/tid=28669] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28669/stat : 28669 (java) S 28655 28657 28325 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28670] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28670/stat : 28670 (java) S 28655 28657 28325 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 522936936 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28671] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28671/stat : 28671 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624934321 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28672] ppid=28655 vsize=15714564 CPUtime=0.98 cores=1,3,5,7
/proc/28657/task/28672/stat : 28672 (java) S 28655 28657 28325 0 -1 4202560 11804 0 0 0 97 1 0 0 15 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 7 0 0 0
[pid=28657/tid=28673] ppid=28655 vsize=15714564 CPUtime=1.2 cores=1,3,5,7
/proc/28657/task/28673/stat : 28673 (java) S 28655 28657 28325 0 -1 4202560 6502 0 0 0 119 1 0 0 15 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 3 0 0 0
[pid=28657/tid=28674] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28674/stat : 28674 (java) S 28655 28657 28325 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624926617 0 4 0 16800975 18446604464474151936 0 0 -1 5 0 0 0
[pid=28657/tid=28675] ppid=28655 vsize=15714564 CPUtime=0 cores=1,3,5,7
/proc/28657/task/28675/stat : 28675 (java) R 28655 28657 28325 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 522936938 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 270624927232 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28657/tid=28676] ppid=28655 vsize=15714564 CPUtime=1191.87 cores=1,3,5,7
/proc/28657/task/28676/stat : 28676 (java) R 28655 28657 28325 0 -1 4202560 244267 0 0 0 119150 37 0 0 25 0 22 0 522936980 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912506156294 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=28657/tid=28677] ppid=28655 vsize=15714564 CPUtime=1190.89 cores=1,3,5,7
/proc/28657/task/28677/stat : 28677 (java) R 28655 28657 28325 0 -1 4202560 239060 0 0 0 119052 37 0 0 25 0 22 0 522936980 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505847975 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28657/tid=28678] ppid=28655 vsize=15714564 CPUtime=1191.57 cores=1,3,5,7
/proc/28657/task/28678/stat : 28678 (java) R 28655 28657 28325 0 -1 4202560 243402 0 0 0 119120 37 0 0 25 0 22 0 522936980 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912505870687 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28657/tid=28679] ppid=28655 vsize=15714564 CPUtime=1190.75 cores=1,3,5,7
/proc/28657/task/28679/stat : 28679 (java) R 28655 28657 28325 0 -1 4202560 239835 0 0 0 119037 38 0 0 25 0 22 0 522936980 16091713536 105172 33554432000 1073741824 1073778376 140733714685776 18446744073709551615 46912506156361 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 15714564

Child status: 143
Real time (s): 1206.74
CPU time (s): 4800.37
CPU user time (s): 4796.28
CPU system time (s): 4.08138
CPU usage (%): 397.796
Max. virtual memory (cumulated for all children) (KiB): 15714564

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.28
system time used= 4.08138
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1843080
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 203451
involuntary context switches= 128142

runsolver used 2.10068 second user time and 4.53331 second system time

The end

Launcher Data 

Begin job on node108 at 2011-04-29 23:42:40
IDJOB=3312396
IDBENCH=82581
IDSOLVER=1699
FILE ID=node108/3312396-1304113360
RUNJOBID= node108-1304110905-28344
PBS_JOBID= 13170680
Free space on /tmp= 72120 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S317257086-003-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312396-1304113360/watcher-3312396-1304113360 -o /tmp/evaluation-result-3312396-1304113360/solver-3312396-1304113360 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312396-1304113360.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6f9c7c042784ec486e9e8bc570309805
RANDOM SEED=738182142

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21059416 kB
Buffers:       1985324 kB
Cached:        7417736 kB
SwapCached:          4 kB
Active:        2214292 kB
Inactive:      9101220 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21059416 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            1992 kB
Writeback:           0 kB
AnonPages:     1912140 kB
Mapped:          23452 kB
Slab:           509280 kB
PageTables:       8584 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2370888 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72120 MiB
End job on node108 at 2011-04-30 00:02:49