Trace number 3312918

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.28 1206.76

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf
MD5SUM08b4f1e095a7a4b98cb40c2c00e78d45
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.477926
Satisfiable
(Un)Satisfiability was proved
Number of variables952
Number of clauses84809
Sum of the clauses size170510
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284779
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 530

Solver Data 

0.10/0.12	48:56 INFO : Reading from input HOME/instance-3312918-1304189335.cnf
0.71/0.52	Executor set job limit to 1000000
0.71/0.52	Executor set job limit to 1000000
0.71/0.52	Executor set job limit to 1000000
0.71/0.52	Executor set job limit to 1000000
0.71/0.52	Starting Executor!
0.71/0.52	Starting Executor!
0.71/0.52	Starting Executor!
0.71/0.52	Starting Executor!
2.32/1.30	48:57 INFO : 952 variables remaining out of 952
2.32/1.30	48:57 INFO : 509656 literals remaining out of 255319

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312918-1304189335/watcher-3312918-1304189335 -o /tmp/evaluation-result-3312918-1304189335/solver-3312918-1304189335 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312918-1304189335.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.31 7.69 7.61 5/198 24610
/proc/meminfo: memFree=22819012/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=23028 CPUtime=0 cores=1,3,5,7
/proc/24610/stat : 24610 (java) R 24608 24610 24018 0 -1 4202496 890 0 0 0 0 0 0 0 25 0 1 0 530533980 23580672 375 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244441982720 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24610/statm: 5757 387 301 9 0 124 0

[startup+0.026981 s]
/proc/loadavg: 8.31 7.69 7.61 5/198 24610
/proc/meminfo: memFree=22819012/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15602060 CPUtime=0.01 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 3379 0 1 0 1 0 0 0 25 0 11 0 530533980 15976509440 2819 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16784584 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3900515 2820 1619 9 0 3891263 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15602060

[startup+0.100964 s]
/proc/loadavg: 8.31 7.69 7.61 5/198 24610
/proc/meminfo: memFree=22819012/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15676264 CPUtime=0.1 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 5558 0 1 0 9 1 0 0 25 0 18 0 530533980 16052494336 4959 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3919066 4959 2116 9 0 3909785 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676264

[startup+0.300924 s]
/proc/loadavg: 8.31 7.69 7.61 5/198 24610
/proc/meminfo: memFree=22819012/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15679244 CPUtime=0.51 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 14292 0 1 0 48 3 0 0 25 0 18 0 530533980 16055545856 12703 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3919811 12710 2207 9 0 3910530 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15679244

[startup+0.701648 s]
/proc/loadavg: 8.31 7.69 7.61 5/198 24610
/proc/meminfo: memFree=22819012/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15683356 CPUtime=1.09 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 44993 0 1 0 102 7 0 0 25 0 22 0 530533980 16059756544 41633 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3920839 41633 2248 9 0 3911558 0
Current children cumulated CPU time (s) 1.09
Current children cumulated vsize (KiB) 15683356

[startup+1.5017 s]
/proc/loadavg: 8.31 7.69 7.61 7/220 24632
/proc/meminfo: memFree=22590056/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15687316 CPUtime=2.66 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 52087 0 1 0 257 9 0 0 25 0 22 0 530533980 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3921829 46451 2269 9 0 3912548 0
[pid=24610/tid=24612] ppid=24608 vsize=15687316 CPUtime=1.28 cores=1,3,5,7
/proc/24610/task/24612/stat : 24612 (java) S 24608 24610 24018 0 -1 4202560 35649 0 1 0 122 6 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24613] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24613/stat : 24613 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24614] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24614/stat : 24614 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24615] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24615/stat : 24615 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24616] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24616/stat : 24616 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24617] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24617/stat : 24617 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24618] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24618/stat : 24618 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24619] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24619/stat : 24619 (java) S 24608 24610 24018 0 -1 4202560 332 0 0 0 0 0 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24620] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24620/stat : 24620 (java) S 24608 24610 24018 0 -1 4202560 66 0 0 0 0 0 0 0 21 0 22 0 530533981 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24621] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24621/stat : 24621 (java) S 24608 24610 24018 0 -1 4202560 10 0 0 0 0 0 0 0 15 0 22 0 530533982 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 0 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24622] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24622/stat : 24622 (java) S 24608 24610 24018 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 530533983 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24623] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24623/stat : 24623 (java) S 24608 24610 24018 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 530533983 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24624] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24624/stat : 24624 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458768817 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24625] ppid=24608 vsize=15687316 CPUtime=0.81 cores=1,3,5,7
/proc/24610/task/24625/stat : 24625 (java) R 24608 24610 24018 0 -1 4202560 12254 0 0 0 80 1 0 0 16 0 22 0 530533985 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 47258989290096 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=24610/tid=24626] ppid=24608 vsize=15687316 CPUtime=0.34 cores=1,3,5,7
/proc/24610/task/24626/stat : 24626 (java) R 24608 24610 24018 0 -1 4202560 2328 0 0 0 34 0 0 0 16 0 22 0 530533985 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244446641931 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=24610/tid=24627] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24627/stat : 24627 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24628] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24628/stat : 24628 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530533985 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24629] ppid=24608 vsize=15687316 CPUtime=0.19 cores=1,3,5,7
/proc/24610/task/24629/stat : 24629 (java) R 24608 24610 24018 0 -1 4202560 26 0 0 0 19 0 0 0 16 0 22 0 530534033 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505932257 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=24610/tid=24630] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24630/stat : 24630 (java) S 24608 24610 24018 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 530534033 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24631] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24631/stat : 24631 (java) S 24608 24610 24018 0 -1 4202560 13 0 0 0 0 0 0 0 15 0 22 0 530534033 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24632] ppid=24608 vsize=15687316 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24632/stat : 24632 (java) S 24608 24610 24018 0 -1 4202560 10 0 0 0 0 0 0 0 15 0 22 0 530534033 16063811584 46451 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 15687316

[startup+3.10137 s]
/proc/loadavg: 8.31 7.69 7.61 8/220 24632
/proc/meminfo: memFree=22488004/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15688604 CPUtime=8.11 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 107018 0 1 0 792 19 0 0 25 0 22 0 530533980 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3922151 101227 2274 9 0 3912870 0
[pid=24610/tid=24612] ppid=24608 vsize=15688604 CPUtime=1.28 cores=1,3,5,7
/proc/24610/task/24612/stat : 24612 (java) S 24608 24610 24018 0 -1 4202560 35649 0 1 0 122 6 0 0 21 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24613] ppid=24608 vsize=15688604 CPUtime=0.01 cores=1,3,5,7
/proc/24610/task/24613/stat : 24613 (java) S 24608 24610 24018 0 -1 4202560 2615 0 0 0 1 0 0 0 15 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24614] ppid=24608 vsize=15688604 CPUtime=0.01 cores=1,3,5,7
/proc/24610/task/24614/stat : 24614 (java) S 24608 24610 24018 0 -1 4202560 3419 0 0 0 1 0 0 0 15 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24615] ppid=24608 vsize=15688604 CPUtime=0.02 cores=1,3,5,7
/proc/24610/task/24615/stat : 24615 (java) S 24608 24610 24018 0 -1 4202560 4495 0 0 0 1 1 0 0 16 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24616] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24616/stat : 24616 (java) S 24608 24610 24018 0 -1 4202560 5443 0 0 0 0 0 0 0 15 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24617] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24617/stat : 24617 (java) S 24608 24610 24018 0 -1 4202560 2947 0 0 0 0 0 0 0 16 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24618] ppid=24608 vsize=15688604 CPUtime=0.02 cores=1,3,5,7
/proc/24610/task/24618/stat : 24618 (java) S 24608 24610 24018 0 -1 4202560 6784 0 0 0 1 1 0 0 15 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24619] ppid=24608 vsize=15688604 CPUtime=0.01 cores=1,3,5,7
/proc/24610/task/24619/stat : 24619 (java) S 24608 24610 24018 0 -1 4202560 3506 0 0 0 1 0 0 0 16 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24620] ppid=24608 vsize=15688604 CPUtime=0.01 cores=1,3,5,7
/proc/24610/task/24620/stat : 24620 (java) S 24608 24610 24018 0 -1 4202560 4476 0 0 0 0 1 0 0 15 0 22 0 530533981 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24621] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24621/stat : 24621 (java) S 24608 24610 24018 0 -1 4202560 217 0 0 0 0 0 0 0 15 0 22 0 530533982 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 0 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24622] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24622/stat : 24622 (java) S 24608 24610 24018 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24623] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24623/stat : 24623 (java) S 24608 24610 24018 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24624] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24624/stat : 24624 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458768817 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24625] ppid=24608 vsize=15688604 CPUtime=0.9 cores=1,3,5,7
/proc/24610/task/24625/stat : 24625 (java) S 24608 24610 24018 0 -1 4202560 12268 0 0 0 89 1 0 0 15 0 22 0 530533985 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24626] ppid=24608 vsize=15688604 CPUtime=0.59 cores=1,3,5,7
/proc/24610/task/24626/stat : 24626 (java) S 24608 24610 24018 0 -1 4202560 2626 0 0 0 59 0 0 0 15 0 22 0 530533985 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24627] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24627/stat : 24627 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24628] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24628/stat : 24628 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 530533985 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24629] ppid=24608 vsize=15688604 CPUtime=1.42 cores=1,3,5,7
/proc/24610/task/24629/stat : 24629 (java) R 24608 24610 24018 0 -1 4202560 5040 0 0 0 142 0 0 0 16 0 22 0 530534033 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505942432 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=24610/tid=24630] ppid=24608 vsize=15688604 CPUtime=1.22 cores=1,3,5,7
/proc/24610/task/24630/stat : 24630 (java) R 24608 24610 24018 0 -1 4202560 5826 0 0 0 122 0 0 0 16 0 22 0 530534033 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505942528 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=24610/tid=24631] ppid=24608 vsize=15688604 CPUtime=1.3 cores=1,3,5,7
/proc/24610/task/24631/stat : 24631 (java) R 24608 24610 24018 0 -1 4202560 4953 0 0 0 130 0 0 0 16 0 22 0 530534033 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505994612 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=24610/tid=24632] ppid=24608 vsize=15688604 CPUtime=1.16 cores=1,3,5,7
/proc/24610/task/24632/stat : 24632 (java) R 24608 24610 24018 0 -1 4202560 5368 0 0 0 116 0 0 0 16 0 22 0 530534033 16065130496 101227 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505942666 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 8.11
Current children cumulated vsize (KiB) 15688604

[startup+6.30077 s]
/proc/loadavg: 8.29 7.69 7.61 9/220 24632
/proc/meminfo: memFree=21841776/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15688604 CPUtime=20.86 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 242963 0 1 0 2049 37 0 0 25 0 22 0 530533980 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3922151 234195 2284 9 0 3912870 0
[pid=24610/tid=24612] ppid=24608 vsize=15688604 CPUtime=1.28 cores=1,3,5,7
/proc/24610/task/24612/stat : 24612 (java) S 24608 24610 24018 0 -1 4202560 35649 0 1 0 122 6 0 0 21 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24613] ppid=24608 vsize=15688604 CPUtime=0.01 cores=1,3,5,7
/proc/24610/task/24613/stat : 24613 (java) S 24608 24610 24018 0 -1 4202560 3702 0 0 0 1 0 0 0 16 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24614] ppid=24608 vsize=15688604 CPUtime=0.02 cores=1,3,5,7
/proc/24610/task/24614/stat : 24614 (java) S 24608 24610 24018 0 -1 4202560 6255 0 0 0 1 1 0 0 15 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24615] ppid=24608 vsize=15688604 CPUtime=0.03 cores=1,3,5,7
/proc/24610/task/24615/stat : 24615 (java) S 24608 24610 24018 0 -1 4202560 8775 0 0 0 2 1 0 0 16 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24616] ppid=24608 vsize=15688604 CPUtime=0.01 cores=1,3,5,7
/proc/24610/task/24616/stat : 24616 (java) S 24608 24610 24018 0 -1 4202560 6369 0 0 0 0 1 0 0 15 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24617] ppid=24608 vsize=15688604 CPUtime=0.02 cores=1,3,5,7
/proc/24610/task/24617/stat : 24617 (java) S 24608 24610 24018 0 -1 4202560 6101 0 0 0 1 1 0 0 16 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24618] ppid=24608 vsize=15688604 CPUtime=0.02 cores=1,3,5,7
/proc/24610/task/24618/stat : 24618 (java) S 24608 24610 24018 0 -1 4202560 8554 0 0 0 1 1 0 0 15 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24619] ppid=24608 vsize=15688604 CPUtime=0.02 cores=1,3,5,7
/proc/24610/task/24619/stat : 24619 (java) S 24608 24610 24018 0 -1 4202560 6780 0 0 0 2 0 0 0 16 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24620] ppid=24608 vsize=15688604 CPUtime=0.01 cores=1,3,5,7
/proc/24610/task/24620/stat : 24620 (java) S 24608 24610 24018 0 -1 4202560 4476 0 0 0 0 1 0 0 15 0 22 0 530533981 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24621] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24621/stat : 24621 (java) S 24608 24610 24018 0 -1 4202560 607 0 0 0 0 0 0 0 15 0 22 0 530533982 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 0 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24622] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24622/stat : 24622 (java) S 24608 24610 24018 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24623] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24623/stat : 24623 (java) S 24608 24610 24018 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24624] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24624/stat : 24624 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458768817 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24625] ppid=24608 vsize=15688604 CPUtime=0.91 cores=1,3,5,7
/proc/24610/task/24625/stat : 24625 (java) S 24608 24610 24018 0 -1 4202560 12268 0 0 0 90 1 0 0 16 0 22 0 530533985 16065130496 234195 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0

################
# More data... #
################

[pid=24610/tid=24630] ppid=24608 vsize=15688604 CPUtime=1107.07 cores=1,3,5,7
/proc/24610/task/24630/stat : 24630 (java) R 24608 24610 24018 0 -1 4202560 415957 0 0 0 110651 56 0 0 25 0 22 0 530534033 16065130496 205122 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912506045064 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=24610/tid=24631] ppid=24608 vsize=15688604 CPUtime=1106.99 cores=1,3,5,7
/proc/24610/task/24631/stat : 24631 (java) R 24608 24610 24018 0 -1 4202560 415281 0 0 0 110641 58 0 0 25 0 22 0 530534033 16065130496 205122 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505942492 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=24610/tid=24632] ppid=24608 vsize=15688604 CPUtime=1106.62 cores=1,3,5,7
/proc/24610/task/24632/stat : 24632 (java) R 24608 24610 24018 0 -1 4202560 404097 0 0 0 110604 58 0 0 25 0 22 0 530534033 16065130496 205122 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505946395 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4464.22
Current children cumulated vsize (KiB) 15688604

[startup+1182.3 s]
/proc/loadavg: 4.04 5.08 6.50 5/193 24695
/proc/meminfo: memFree=22591452/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15688604 CPUtime=4703.1 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 3397697 0 1 0 469661 649 0 0 25 0 22 0 530533980 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3922151 226884 2297 9 0 3912870 0
[pid=24610/tid=24612] ppid=24608 vsize=15688604 CPUtime=1.28 cores=1,3,5,7
/proc/24610/task/24612/stat : 24612 (java) S 24608 24610 24018 0 -1 4202560 35649 0 1 0 122 6 0 0 21 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24613] ppid=24608 vsize=15688604 CPUtime=4.03 cores=1,3,5,7
/proc/24610/task/24613/stat : 24613 (java) S 24608 24610 24018 0 -1 4202560 205821 0 0 0 363 40 0 0 15 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24614] ppid=24608 vsize=15688604 CPUtime=3.87 cores=1,3,5,7
/proc/24610/task/24614/stat : 24614 (java) S 24608 24610 24018 0 -1 4202560 195133 0 0 0 353 34 0 0 15 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24615] ppid=24608 vsize=15688604 CPUtime=4 cores=1,3,5,7
/proc/24610/task/24615/stat : 24615 (java) S 24608 24610 24018 0 -1 4202560 209066 0 0 0 358 42 0 0 16 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24616] ppid=24608 vsize=15688604 CPUtime=3.91 cores=1,3,5,7
/proc/24610/task/24616/stat : 24616 (java) S 24608 24610 24018 0 -1 4202560 205760 0 0 0 353 38 0 0 15 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24617] ppid=24608 vsize=15688604 CPUtime=3.89 cores=1,3,5,7
/proc/24610/task/24617/stat : 24617 (java) S 24608 24610 24018 0 -1 4202560 195330 0 0 0 351 38 0 0 15 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24618] ppid=24608 vsize=15688604 CPUtime=3.87 cores=1,3,5,7
/proc/24610/task/24618/stat : 24618 (java) S 24608 24610 24018 0 -1 4202560 196311 0 0 0 346 41 0 0 15 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24619] ppid=24608 vsize=15688604 CPUtime=4.05 cores=1,3,5,7
/proc/24610/task/24619/stat : 24619 (java) S 24608 24610 24018 0 -1 4202560 206998 0 0 0 362 43 0 0 15 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24620] ppid=24608 vsize=15688604 CPUtime=3.95 cores=1,3,5,7
/proc/24610/task/24620/stat : 24620 (java) S 24608 24610 24018 0 -1 4202560 199032 0 0 0 355 40 0 0 16 0 22 0 530533981 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24621] ppid=24608 vsize=15688604 CPUtime=2.55 cores=1,3,5,7
/proc/24610/task/24621/stat : 24621 (java) S 24608 24610 24018 0 -1 4202560 9204 0 0 0 177 78 0 0 16 0 22 0 530533982 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 0 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24622] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24622/stat : 24622 (java) S 24608 24610 24018 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24623] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24623/stat : 24623 (java) S 24608 24610 24018 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24624] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24624/stat : 24624 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458768817 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24625] ppid=24608 vsize=15688604 CPUtime=1.18 cores=1,3,5,7
/proc/24610/task/24625/stat : 24625 (java) S 24608 24610 24018 0 -1 4202560 12333 0 0 0 117 1 0 0 16 0 22 0 530533985 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24626] ppid=24608 vsize=15688604 CPUtime=0.85 cores=1,3,5,7
/proc/24610/task/24626/stat : 24626 (java) S 24608 24610 24018 0 -1 4202560 2671 0 0 0 85 0 0 0 16 0 22 0 530533985 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24627] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24627/stat : 24627 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24628] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24628/stat : 24628 (java) S 24608 24610 24018 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 530533985 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24629] ppid=24608 vsize=15688604 CPUtime=1166.87 cores=1,3,5,7
/proc/24610/task/24629/stat : 24629 (java) R 24608 24610 24018 0 -1 4202560 427442 0 0 0 116629 58 0 0 25 0 22 0 530534033 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505946395 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=24610/tid=24630] ppid=24608 vsize=15688604 CPUtime=1166.38 cores=1,3,5,7
/proc/24610/task/24630/stat : 24630 (java) R 24608 24610 24018 0 -1 4202560 435777 0 0 0 116579 59 0 0 25 0 22 0 530534033 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505942459 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=24610/tid=24631] ppid=24608 vsize=15688604 CPUtime=1166.37 cores=1,3,5,7
/proc/24610/task/24631/stat : 24631 (java) R 24608 24610 24018 0 -1 4202560 435079 0 0 0 116576 61 0 0 25 0 22 0 530534033 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912506352021 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=24610/tid=24632] ppid=24608 vsize=15688604 CPUtime=1165.88 cores=1,3,5,7
/proc/24610/task/24632/stat : 24632 (java) R 24608 24610 24018 0 -1 4202560 424638 0 0 0 116527 61 0 0 25 0 22 0 530534033 16065130496 226884 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505946481 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4703.1
Current children cumulated vsize (KiB) 15688604



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.71 s]
/proc/loadavg: 4.02 5.00 6.43 5/193 24696
/proc/meminfo: memFree=22613636/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15688604 CPUtime=4800.21 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 3461687 0 1 0 479359 662 0 0 25 0 22 0 530533980 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3922151 217861 2297 9 0 3912870 0
[pid=24610/tid=24612] ppid=24608 vsize=15688604 CPUtime=1.28 cores=1,3,5,7
/proc/24610/task/24612/stat : 24612 (java) S 24608 24610 24018 0 -1 4202560 35649 0 1 0 122 6 0 0 21 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24613] ppid=24608 vsize=15688604 CPUtime=4.1 cores=1,3,5,7
/proc/24610/task/24613/stat : 24613 (java) S 24608 24610 24018 0 -1 4202560 208124 0 0 0 370 40 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24614] ppid=24608 vsize=15688604 CPUtime=3.94 cores=1,3,5,7
/proc/24610/task/24614/stat : 24614 (java) S 24608 24610 24018 0 -1 4202560 197708 0 0 0 359 35 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24615] ppid=24608 vsize=15688604 CPUtime=4.07 cores=1,3,5,7
/proc/24610/task/24615/stat : 24615 (java) S 24608 24610 24018 0 -1 4202560 210778 0 0 0 365 42 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24616] ppid=24608 vsize=15688604 CPUtime=3.98 cores=1,3,5,7
/proc/24610/task/24616/stat : 24616 (java) S 24608 24610 24018 0 -1 4202560 207616 0 0 0 359 39 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24617] ppid=24608 vsize=15688604 CPUtime=3.97 cores=1,3,5,7
/proc/24610/task/24617/stat : 24617 (java) S 24608 24610 24018 0 -1 4202560 198065 0 0 0 358 39 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24618] ppid=24608 vsize=15688604 CPUtime=3.94 cores=1,3,5,7
/proc/24610/task/24618/stat : 24618 (java) S 24608 24610 24018 0 -1 4202560 198980 0 0 0 353 41 0 0 16 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24619] ppid=24608 vsize=15688604 CPUtime=4.13 cores=1,3,5,7
/proc/24610/task/24619/stat : 24619 (java) S 24608 24610 24018 0 -1 4202560 210360 0 0 0 370 43 0 0 16 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24620] ppid=24608 vsize=15688604 CPUtime=4.04 cores=1,3,5,7
/proc/24610/task/24620/stat : 24620 (java) S 24608 24610 24018 0 -1 4202560 202068 0 0 0 363 41 0 0 16 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24621] ppid=24608 vsize=15688604 CPUtime=2.62 cores=1,3,5,7
/proc/24610/task/24621/stat : 24621 (java) S 24608 24610 24018 0 -1 4202560 9291 0 0 0 182 80 0 0 15 0 22 0 530533982 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 0 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24622] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24622/stat : 24622 (java) S 24608 24610 24018 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24623] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24623/stat : 24623 (java) S 24608 24610 24018 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24624] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24624/stat : 24624 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458768817 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24625] ppid=24608 vsize=15688604 CPUtime=1.18 cores=1,3,5,7
/proc/24610/task/24625/stat : 24625 (java) S 24608 24610 24018 0 -1 4202560 12333 0 0 0 117 1 0 0 16 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24626] ppid=24608 vsize=15688604 CPUtime=0.85 cores=1,3,5,7
/proc/24610/task/24626/stat : 24626 (java) S 24608 24610 24018 0 -1 4202560 2671 0 0 0 85 0 0 0 16 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24627] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24627/stat : 24627 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24628] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24628/stat : 24628 (java) S 24608 24610 24018 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24629] ppid=24608 vsize=15688604 CPUtime=1190.88 cores=1,3,5,7
/proc/24610/task/24629/stat : 24629 (java) R 24608 24610 24018 0 -1 4202560 438627 0 0 0 119028 60 0 0 25 0 22 0 530534033 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505894844 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=24610/tid=24630] ppid=24608 vsize=15688604 CPUtime=1190.52 cores=1,3,5,7
/proc/24610/task/24630/stat : 24630 (java) R 24608 24610 24018 0 -1 4202560 446208 0 0 0 118991 61 0 0 25 0 22 0 530534033 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505942542 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=24610/tid=24631] ppid=24608 vsize=15688604 CPUtime=1190.5 cores=1,3,5,7
/proc/24610/task/24631/stat : 24631 (java) R 24608 24610 24018 0 -1 4202560 447003 0 0 0 118988 62 0 0 25 0 22 0 530534033 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505960288 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=24610/tid=24632] ppid=24608 vsize=15688604 CPUtime=1190.03 cores=1,3,5,7
/proc/24610/task/24632/stat : 24632 (java) R 24608 24610 24018 0 -1 4202560 434753 0 0 0 118940 63 0 0 25 0 22 0 530534033 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912506039524 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 15688604

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1206.71 s]
/proc/loadavg: 4.02 5.00 6.43 5/193 24696
/proc/meminfo: memFree=22613636/32951124 swapFree=67111524/67111528
[pid=24610] ppid=24608 vsize=15688604 CPUtime=4800.21 cores=1,3,5,7
/proc/24610/stat : 24610 (java) S 24608 24610 24018 0 -1 4202496 3461687 0 1 0 479359 662 0 0 25 0 22 0 530533980 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/24610/statm: 3922151 217861 2297 9 0 3912870 0
[pid=24610/tid=24612] ppid=24608 vsize=15688604 CPUtime=1.28 cores=1,3,5,7
/proc/24610/task/24612/stat : 24612 (java) S 24608 24610 24018 0 -1 4202560 35649 0 1 0 122 6 0 0 21 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24613] ppid=24608 vsize=15688604 CPUtime=4.1 cores=1,3,5,7
/proc/24610/task/24613/stat : 24613 (java) S 24608 24610 24018 0 -1 4202560 208124 0 0 0 370 40 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24614] ppid=24608 vsize=15688604 CPUtime=3.94 cores=1,3,5,7
/proc/24610/task/24614/stat : 24614 (java) S 24608 24610 24018 0 -1 4202560 197708 0 0 0 359 35 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24615] ppid=24608 vsize=15688604 CPUtime=4.07 cores=1,3,5,7
/proc/24610/task/24615/stat : 24615 (java) S 24608 24610 24018 0 -1 4202560 210778 0 0 0 365 42 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24616] ppid=24608 vsize=15688604 CPUtime=3.98 cores=1,3,5,7
/proc/24610/task/24616/stat : 24616 (java) S 24608 24610 24018 0 -1 4202560 207616 0 0 0 359 39 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24617] ppid=24608 vsize=15688604 CPUtime=3.97 cores=1,3,5,7
/proc/24610/task/24617/stat : 24617 (java) S 24608 24610 24018 0 -1 4202560 198065 0 0 0 358 39 0 0 15 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24618] ppid=24608 vsize=15688604 CPUtime=3.94 cores=1,3,5,7
/proc/24610/task/24618/stat : 24618 (java) S 24608 24610 24018 0 -1 4202560 198980 0 0 0 353 41 0 0 16 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24619] ppid=24608 vsize=15688604 CPUtime=4.13 cores=1,3,5,7
/proc/24610/task/24619/stat : 24619 (java) S 24608 24610 24018 0 -1 4202560 210360 0 0 0 370 43 0 0 16 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 7 0 0 0
[pid=24610/tid=24620] ppid=24608 vsize=15688604 CPUtime=4.04 cores=1,3,5,7
/proc/24610/task/24620/stat : 24620 (java) S 24608 24610 24018 0 -1 4202560 202068 0 0 0 363 41 0 0 16 0 22 0 530533981 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24621] ppid=24608 vsize=15688604 CPUtime=2.62 cores=1,3,5,7
/proc/24610/task/24621/stat : 24621 (java) S 24608 24610 24018 0 -1 4202560 9291 0 0 0 182 80 0 0 15 0 22 0 530533982 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 0 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24622] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24622/stat : 24622 (java) S 24608 24610 24018 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24623] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24623/stat : 24623 (java) S 24608 24610 24018 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 530533983 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24624] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24624/stat : 24624 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458768817 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24625] ppid=24608 vsize=15688604 CPUtime=1.18 cores=1,3,5,7
/proc/24610/task/24625/stat : 24625 (java) S 24608 24610 24018 0 -1 4202560 12333 0 0 0 117 1 0 0 16 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 1 0 0 0
[pid=24610/tid=24626] ppid=24608 vsize=15688604 CPUtime=0.85 cores=1,3,5,7
/proc/24610/task/24626/stat : 24626 (java) S 24608 24610 24018 0 -1 4202560 2671 0 0 0 85 0 0 0 16 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 3 0 0 0
[pid=24610/tid=24627] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24627/stat : 24627 (java) S 24608 24610 24018 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761113 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24628] ppid=24608 vsize=15688604 CPUtime=0 cores=1,3,5,7
/proc/24610/task/24628/stat : 24628 (java) S 24608 24610 24018 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 530533985 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 244458761728 0 4 0 16800975 18446604471078587200 0 0 -1 5 0 0 0
[pid=24610/tid=24629] ppid=24608 vsize=15688604 CPUtime=1190.88 cores=1,3,5,7
/proc/24610/task/24629/stat : 24629 (java) R 24608 24610 24018 0 -1 4202560 438627 0 0 0 119028 60 0 0 25 0 22 0 530534033 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505894844 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=24610/tid=24630] ppid=24608 vsize=15688604 CPUtime=1190.52 cores=1,3,5,7
/proc/24610/task/24630/stat : 24630 (java) R 24608 24610 24018 0 -1 4202560 446208 0 0 0 118991 61 0 0 25 0 22 0 530534033 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505942542 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=24610/tid=24631] ppid=24608 vsize=15688604 CPUtime=1190.5 cores=1,3,5,7
/proc/24610/task/24631/stat : 24631 (java) R 24608 24610 24018 0 -1 4202560 447003 0 0 0 118988 62 0 0 25 0 22 0 530534033 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912505960288 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=24610/tid=24632] ppid=24608 vsize=15688604 CPUtime=1190.03 cores=1,3,5,7
/proc/24610/task/24632/stat : 24632 (java) R 24608 24610 24018 0 -1 4202560 434753 0 0 0 118940 63 0 0 25 0 22 0 530534033 16065130496 217861 33554432000 1073741824 1073778376 140734004289680 18446744073709551615 46912506039524 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 15688604

Child status: 143
Real time (s): 1206.76
CPU time (s): 4800.28
CPU user time (s): 4793.62
CPU system time (s): 6.66299
CPU usage (%): 397.782
Max. virtual memory (cumulated for all children) (KiB): 15688604

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4793.62
system time used= 6.66299
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3461713
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 121115
involuntary context switches= 90869

runsolver used 1.9627 second user time and 4.70129 second system time

The end

Launcher Data 

Begin job on node105 at 2011-04-30 20:48:55
IDJOB=3312918
IDBENCH=88227
IDSOLVER=1699
FILE ID=node105/3312918-1304189335
RUNJOBID= node105-1304188900-24508
PBS_JOBID= 13172475
Free space on /tmp= 73040 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312918-1304189335/watcher-3312918-1304189335 -o /tmp/evaluation-result-3312918-1304189335/solver-3312918-1304189335 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312918-1304189335.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 08b4f1e095a7a4b98cb40c2c00e78d45
RANDOM SEED=631449716

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22819284 kB
Buffers:       2182352 kB
Cached:        6675896 kB
SwapCached:          4 kB
Active:        1333772 kB
Inactive:      8245020 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22819284 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            2424 kB
Writeback:           0 kB
AnonPages:      719892 kB
Mapped:          23620 kB
Slab:           488420 kB
PageTables:       7296 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   983468 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73040 MiB
End job on node105 at 2011-04-30 21:09:04