Trace number 3311431

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.42 1206.63

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v700-c2982-S628307658-028.SATISFIABLE.cnf
MD5SUM0b3e0de9aa59dd098eea77ce3aaba6c9
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.031995
Satisfiable
(Un)Satisfiability was proved
Number of variables700
Number of clauses2982
Sum of the clauses size8946
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32982
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.09/0.13	29:26 INFO : Reading from input HOME/instance-3311431-1304126966.cnf
0.27/0.27	Executor set job limit to 1000000
0.27/0.27	Executor set job limit to 1000000
0.27/0.27	Executor set job limit to 1000000
0.27/0.27	Executor set job limit to 1000000
0.27/0.27	Starting Executor!
0.27/0.27	Starting Executor!
0.27/0.27	Starting Executor!
0.27/0.27	Starting Executor!
0.74/0.41	29:27 INFO : 696 variables remaining out of 700
0.74/0.41	29:27 INFO : 11840 literals remaining out of 11928

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311431-1304126966/watcher-3311431-1304126966 -o /tmp/evaluation-result-3311431-1304126966/solver-3311431-1304126966 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311431-1304126966.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.48 7.93 7.43 3/176 28325
/proc/meminfo: memFree=24377056/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=5592 CPUtime=0 cores=1,3,5,7
/proc/28325/stat : 28325 (java) R 28321 28325 27450 0 -1 4194304 549 0 0 0 0 0 0 0 17 0 1 0 602927271 5726208 53 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216730254983 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/28325/statm: 1398 53 41 9 0 27 0

[startup+0.067581 s]
/proc/loadavg: 7.48 7.93 7.43 3/176 28325
/proc/meminfo: memFree=24377056/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15609648 CPUtime=0.04 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 4136 0 1 0 3 1 0 0 17 0 18 0 602927271 15984279552 3574 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3902412 3575 1755 9 0 3893131 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 15609648

[startup+0.100613 s]
/proc/loadavg: 7.48 7.93 7.43 3/176 28325
/proc/meminfo: memFree=24377056/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15677096 CPUtime=0.09 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 5441 0 1 0 7 2 0 0 17 0 18 0 602927271 16053346304 4854 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3919274 4855 2115 9 0 3909993 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15677096

[startup+0.306566 s]
/proc/loadavg: 7.48 7.93 7.43 3/176 28325
/proc/meminfo: memFree=24377056/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15686624 CPUtime=0.5 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 11799 0 1 0 47 3 0 0 17 0 22 0 602927271 16063102976 10207 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3921656 10207 2212 9 0 3912375 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 15686624

[startup+0.70044 s]
/proc/loadavg: 7.48 7.93 7.43 3/176 28325
/proc/meminfo: memFree=24377056/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15700756 CPUtime=1.83 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 29101 0 1 0 177 6 0 0 17 0 22 0 602927271 16077574144 24132 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3925189 24132 2259 9 0 3915908 0
Current children cumulated CPU time (s) 1.83
Current children cumulated vsize (KiB) 15700756

[startup+1.5013 s]
/proc/loadavg: 7.48 7.93 7.43 14/220 28369
/proc/meminfo: memFree=24015088/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15698152 CPUtime=5.02 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 62681 0 1 0 492 10 0 0 17 0 22 0 602927271 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3924538 56705 2273 9 0 3915257 0
[pid=28325/tid=28328] ppid=28321 vsize=15698152 CPUtime=0.38 cores=1,3,5,7
/proc/28325/task/28328/stat : 28328 (java) S 28321 28325 27450 0 -1 4202560 6975 0 1 0 36 2 0 0 20 0 22 0 602927272 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28330] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28330/stat : 28330 (java) S 28321 28325 27450 0 -1 4202560 1535 0 0 0 0 0 0 0 16 0 22 0 602927273 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28332] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28332/stat : 28332 (java) S 28321 28325 27450 0 -1 4202560 691 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28334] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28334/stat : 28334 (java) S 28321 28325 27450 0 -1 4202560 2326 0 0 0 0 0 0 0 16 0 22 0 602927273 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28336] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28336/stat : 28336 (java) S 28321 28325 27450 0 -1 4202560 908 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28338] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28338/stat : 28338 (java) S 28321 28325 27450 0 -1 4202560 872 0 0 0 0 0 0 0 16 0 22 0 602927273 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28340] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28340/stat : 28340 (java) S 28321 28325 27450 0 -1 4202560 1426 0 0 0 0 0 0 0 16 0 22 0 602927273 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28342] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28342/stat : 28342 (java) S 28321 28325 27450 0 -1 4202560 1193 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28344] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28344/stat : 28344 (java) S 28321 28325 27450 0 -1 4202560 546 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28346] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28346/stat : 28346 (java) S 28321 28325 27450 0 -1 4202560 75 0 0 0 0 0 0 0 15 0 22 0 602927274 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 0 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28348] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28348/stat : 28348 (java) S 28321 28325 27450 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602927274 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28350] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28350/stat : 28350 (java) S 28321 28325 27450 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 602927274 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28353] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28353/stat : 28353 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 602927277 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216747002289 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28355] ppid=28321 vsize=15698152 CPUtime=0.72 cores=1,3,5,7
/proc/28325/task/28355/stat : 28355 (java) S 28321 28325 27450 0 -1 4202560 6025 0 0 0 72 0 0 0 17 0 22 0 602927277 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28359] ppid=28321 vsize=15698152 CPUtime=0.79 cores=1,3,5,7
/proc/28325/task/28359/stat : 28359 (java) S 28321 28325 27450 0 -1 4202560 9928 0 0 0 78 1 0 0 15 0 22 0 602927277 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28360] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28360/stat : 28360 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 22 0 602927277 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28361] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28361/stat : 28361 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 602927277 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28362] ppid=28321 vsize=15698152 CPUtime=1.04 cores=1,3,5,7
/proc/28325/task/28362/stat : 28362 (java) R 28321 28325 27450 0 -1 4202560 11610 0 0 0 103 1 0 0 19 0 22 0 602927299 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912506168212 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28325/tid=28363] ppid=28321 vsize=15698152 CPUtime=0.51 cores=1,3,5,7
/proc/28325/task/28363/stat : 28363 (java) R 28321 28325 27450 0 -1 4202560 1489 0 0 0 51 0 0 0 18 0 22 0 602927299 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505728837 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28325/tid=28364] ppid=28321 vsize=15698152 CPUtime=0.91 cores=1,3,5,7
/proc/28325/task/28364/stat : 28364 (java) R 28321 28325 27450 0 -1 4202560 11356 0 0 0 90 1 0 0 19 0 22 0 602927299 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912506169713 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28325/tid=28365] ppid=28321 vsize=15698152 CPUtime=0.54 cores=1,3,5,7
/proc/28325/task/28365/stat : 28365 (java) R 28321 28325 27450 0 -1 4202560 4337 0 0 0 54 0 0 0 19 0 22 0 602927299 16074907648 56705 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912506159216 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.02
Current children cumulated vsize (KiB) 15698152

[startup+3.10102 s]
/proc/loadavg: 7.48 7.93 7.43 10/220 28369
/proc/meminfo: memFree=23844152/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15698152 CPUtime=11.41 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 155603 0 1 0 1118 23 0 0 17 0 22 0 602927271 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3924538 149544 2277 9 0 3915257 0
[pid=28325/tid=28328] ppid=28321 vsize=15698152 CPUtime=0.38 cores=1,3,5,7
/proc/28325/task/28328/stat : 28328 (java) S 28321 28325 27450 0 -1 4202560 6975 0 1 0 36 2 0 0 20 0 22 0 602927272 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28330] ppid=28321 vsize=15698152 CPUtime=0.01 cores=1,3,5,7
/proc/28325/task/28330/stat : 28330 (java) S 28321 28325 27450 0 -1 4202560 3684 0 0 0 1 0 0 0 15 0 22 0 602927273 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28332] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28332/stat : 28332 (java) S 28321 28325 27450 0 -1 4202560 691 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28334] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28334/stat : 28334 (java) S 28321 28325 27450 0 -1 4202560 2326 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28336] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28336/stat : 28336 (java) S 28321 28325 27450 0 -1 4202560 3545 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28338] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28338/stat : 28338 (java) S 28321 28325 27450 0 -1 4202560 1178 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28340] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28340/stat : 28340 (java) S 28321 28325 27450 0 -1 4202560 3433 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28342] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28342/stat : 28342 (java) S 28321 28325 27450 0 -1 4202560 2927 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28344] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28344/stat : 28344 (java) S 28321 28325 27450 0 -1 4202560 1293 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28346] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28346/stat : 28346 (java) S 28321 28325 27450 0 -1 4202560 450 0 0 0 0 0 0 0 15 0 22 0 602927274 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 0 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28348] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28348/stat : 28348 (java) S 28321 28325 27450 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602927274 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28350] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28350/stat : 28350 (java) S 28321 28325 27450 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 602927274 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28353] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28353/stat : 28353 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 602927277 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216747002289 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28355] ppid=28321 vsize=15698152 CPUtime=0.76 cores=1,3,5,7
/proc/28325/task/28355/stat : 28355 (java) S 28321 28325 27450 0 -1 4202560 6035 0 0 0 76 0 0 0 15 0 22 0 602927277 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28359] ppid=28321 vsize=15698152 CPUtime=0.81 cores=1,3,5,7
/proc/28325/task/28359/stat : 28359 (java) S 28321 28325 27450 0 -1 4202560 9929 0 0 0 80 1 0 0 15 0 22 0 602927277 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28360] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28360/stat : 28360 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 22 0 602927277 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28361] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28361/stat : 28361 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 602927277 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28362] ppid=28321 vsize=15698152 CPUtime=2.62 cores=1,3,5,7
/proc/28325/task/28362/stat : 28362 (java) R 28321 28325 27450 0 -1 4202560 32231 0 0 0 258 4 0 0 23 0 22 0 602927299 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505859594 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28325/tid=28363] ppid=28321 vsize=15698152 CPUtime=2.09 cores=1,3,5,7
/proc/28325/task/28363/stat : 28363 (java) R 28321 28325 27450 0 -1 4202560 21762 0 0 0 207 2 0 0 20 0 22 0 602927299 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 18446744073699065863 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28325/tid=28364] ppid=28321 vsize=15698152 CPUtime=2.48 cores=1,3,5,7
/proc/28325/task/28364/stat : 28364 (java) R 28321 28325 27450 0 -1 4202560 32007 0 0 0 244 4 0 0 21 0 22 0 602927299 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505796636 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28325/tid=28365] ppid=28321 vsize=15698152 CPUtime=2.09 cores=1,3,5,7
/proc/28325/task/28365/stat : 28365 (java) R 28321 28325 27450 0 -1 4202560 25748 0 0 0 207 2 0 0 22 0 22 0 602927299 16074907648 149544 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505704945 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.41
Current children cumulated vsize (KiB) 15698152

[startup+6.30146 s]
/proc/loadavg: 7.60 7.95 7.44 9/220 28369
/proc/meminfo: memFree=23140700/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15698152 CPUtime=24.18 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 282421 0 1 0 2380 38 0 0 17 0 22 0 602927271 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3924538 273650 2277 9 0 3915257 0
[pid=28325/tid=28328] ppid=28321 vsize=15698152 CPUtime=0.38 cores=1,3,5,7
/proc/28325/task/28328/stat : 28328 (java) S 28321 28325 27450 0 -1 4202560 6975 0 1 0 36 2 0 0 20 0 22 0 602927272 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28330] ppid=28321 vsize=15698152 CPUtime=0.01 cores=1,3,5,7
/proc/28325/task/28330/stat : 28330 (java) S 28321 28325 27450 0 -1 4202560 4212 0 0 0 1 0 0 0 15 0 22 0 602927273 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28332] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28332/stat : 28332 (java) S 28321 28325 27450 0 -1 4202560 1458 0 0 0 0 0 0 0 16 0 22 0 602927273 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28334] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28334/stat : 28334 (java) S 28321 28325 27450 0 -1 4202560 3578 0 0 0 0 0 0 0 16 0 22 0 602927273 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28336] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28336/stat : 28336 (java) S 28321 28325 27450 0 -1 4202560 3716 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28338] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28338/stat : 28338 (java) S 28321 28325 27450 0 -1 4202560 1485 0 0 0 0 0 0 0 16 0 22 0 602927273 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28340] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28340/stat : 28340 (java) S 28321 28325 27450 0 -1 4202560 3433 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28342] ppid=28321 vsize=15698152 CPUtime=0.01 cores=1,3,5,7
/proc/28325/task/28342/stat : 28342 (java) S 28321 28325 27450 0 -1 4202560 3140 0 0 0 1 0 0 0 16 0 22 0 602927273 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28344] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28344/stat : 28344 (java) S 28321 28325 27450 0 -1 4202560 1456 0 0 0 0 0 0 0 15 0 22 0 602927273 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28346] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28346/stat : 28346 (java) S 28321 28325 27450 0 -1 4202560 450 0 0 0 0 0 0 0 15 0 22 0 602927274 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 0 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28348] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28348/stat : 28348 (java) S 28321 28325 27450 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602927274 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28350] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28350/stat : 28350 (java) S 28321 28325 27450 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 602927274 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28353] ppid=28321 vsize=15698152 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28353/stat : 28353 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 602927277 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216747002289 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28355] ppid=28321 vsize=15698152 CPUtime=0.83 cores=1,3,5,7
/proc/28325/task/28355/stat : 28355 (java) S 28321 28325 27450 0 -1 4202560 6071 0 0 0 83 0 0 0 15 0 22 0 602927277 16074907648 273650 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=28325/tid=28363] ppid=28321 vsize=15763688 CPUtime=1108.16 cores=1,3,5,7
/proc/28325/task/28363/stat : 28363 (java) R 28321 28325 27450 0 -1 4202560 400144 0 0 0 110763 53 0 0 25 0 22 0 602927299 16142016512 112143 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505649920 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28325/tid=28364] ppid=28321 vsize=15763688 CPUtime=1107.74 cores=1,3,5,7
/proc/28325/task/28364/stat : 28364 (java) R 28321 28325 27450 0 -1 4202560 407195 0 0 0 110720 54 0 0 25 0 22 0 602927299 16142016512 112143 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505808873 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28325/tid=28365] ppid=28321 vsize=15763688 CPUtime=1107.94 cores=1,3,5,7
/proc/28325/task/28365/stat : 28365 (java) R 28321 28325 27450 0 -1 4202560 405841 0 0 0 110738 56 0 0 25 0 22 0 602927299 16142016512 112143 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505859808 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4465.04
Current children cumulated vsize (KiB) 15763688

[startup+1182.3 s]
/proc/loadavg: 8.25 8.12 7.88 9/220 28403
/proc/meminfo: memFree=23565916/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15763688 CPUtime=4703.72 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 3009623 0 1 0 469812 560 0 0 17 0 22 0 602927271 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3940922 121128 2298 9 0 3931641 0
[pid=28325/tid=28328] ppid=28321 vsize=15763688 CPUtime=0.38 cores=1,3,5,7
/proc/28325/task/28328/stat : 28328 (java) S 28321 28325 27450 0 -1 4202560 6975 0 1 0 36 2 0 0 20 0 22 0 602927272 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28330] ppid=28321 vsize=15763688 CPUtime=3.73 cores=1,3,5,7
/proc/28325/task/28330/stat : 28330 (java) S 28321 28325 27450 0 -1 4202560 164595 0 0 0 345 28 0 0 16 0 22 0 602927273 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28332] ppid=28321 vsize=15763688 CPUtime=3.62 cores=1,3,5,7
/proc/28325/task/28332/stat : 28332 (java) S 28321 28325 27450 0 -1 4202560 162518 0 0 0 333 29 0 0 15 0 22 0 602927273 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28334] ppid=28321 vsize=15763688 CPUtime=3.64 cores=1,3,5,7
/proc/28325/task/28334/stat : 28334 (java) S 28321 28325 27450 0 -1 4202560 152807 0 0 0 335 29 0 0 15 0 22 0 602927273 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28336] ppid=28321 vsize=15763688 CPUtime=3.67 cores=1,3,5,7
/proc/28325/task/28336/stat : 28336 (java) S 28321 28325 27450 0 -1 4202560 164809 0 0 0 339 28 0 0 16 0 22 0 602927273 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28338] ppid=28321 vsize=15763688 CPUtime=3.62 cores=1,3,5,7
/proc/28325/task/28338/stat : 28338 (java) S 28321 28325 27450 0 -1 4202560 153002 0 0 0 334 28 0 0 15 0 22 0 602927273 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28340] ppid=28321 vsize=15763688 CPUtime=3.58 cores=1,3,5,7
/proc/28325/task/28340/stat : 28340 (java) S 28321 28325 27450 0 -1 4202560 160748 0 0 0 327 31 0 0 16 0 22 0 602927273 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28342] ppid=28321 vsize=15763688 CPUtime=3.63 cores=1,3,5,7
/proc/28325/task/28342/stat : 28342 (java) S 28321 28325 27450 0 -1 4202560 156497 0 0 0 334 29 0 0 15 0 22 0 602927273 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28344] ppid=28321 vsize=15763688 CPUtime=3.58 cores=1,3,5,7
/proc/28325/task/28344/stat : 28344 (java) S 28321 28325 27450 0 -1 4202560 162098 0 0 0 331 27 0 0 15 0 22 0 602927273 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28346] ppid=28321 vsize=15763688 CPUtime=2.07 cores=1,3,5,7
/proc/28325/task/28346/stat : 28346 (java) S 28321 28325 27450 0 -1 4202560 7640 0 0 0 121 86 0 0 15 0 22 0 602927274 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 0 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28348] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28348/stat : 28348 (java) S 28321 28325 27450 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602927274 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28350] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28350/stat : 28350 (java) S 28321 28325 27450 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 602927274 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28353] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28353/stat : 28353 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 602927277 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216747002289 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28355] ppid=28321 vsize=15763688 CPUtime=0.92 cores=1,3,5,7
/proc/28325/task/28355/stat : 28355 (java) S 28321 28325 27450 0 -1 4202560 6096 0 0 0 92 0 0 0 15 0 22 0 602927277 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28359] ppid=28321 vsize=15763688 CPUtime=0.98 cores=1,3,5,7
/proc/28325/task/28359/stat : 28359 (java) S 28321 28325 27450 0 -1 4202560 9956 0 0 0 97 1 0 0 15 0 22 0 602927277 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28360] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28360/stat : 28360 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 22 0 602927277 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28361] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28361/stat : 28361 (java) S 28321 28325 27450 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 602927277 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28362] ppid=28321 vsize=15763688 CPUtime=1168.27 cores=1,3,5,7
/proc/28325/task/28362/stat : 28362 (java) R 28321 28325 27450 0 -1 4202560 430784 0 0 0 116769 58 0 0 25 0 22 0 602927299 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912506044434 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=28325/tid=28363] ppid=28321 vsize=15763688 CPUtime=1167.46 cores=1,3,5,7
/proc/28325/task/28363/stat : 28363 (java) R 28321 28325 27450 0 -1 4202560 418862 0 0 0 116690 56 0 0 25 0 22 0 602927299 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 18446744073699065863 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=28325/tid=28364] ppid=28321 vsize=15763688 CPUtime=1167.08 cores=1,3,5,7
/proc/28325/task/28364/stat : 28364 (java) R 28321 28325 27450 0 -1 4202560 426467 0 0 0 116650 58 0 0 25 0 22 0 602927299 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505672915 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28325/tid=28365] ppid=28321 vsize=15763688 CPUtime=1167.29 cores=1,3,5,7
/proc/28325/task/28365/stat : 28365 (java) R 28321 28325 27450 0 -1 4202560 424312 0 0 0 116670 59 0 0 25 0 22 0 602927299 16142016512 121128 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505766385 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4703.72
Current children cumulated vsize (KiB) 15763688



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.6 s]
/proc/loadavg: 8.17 8.11 7.89 10/220 28404
/proc/meminfo: memFree=23702932/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15763688 CPUtime=4800.36 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 3053256 0 1 0 479467 569 0 0 17 0 22 0 602927271 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3940922 94146 2298 9 0 3931641 0
[pid=28325/tid=28328] ppid=28321 vsize=15763688 CPUtime=0.38 cores=1,3,5,7
/proc/28325/task/28328/stat : 28328 (java) S 28321 28325 27450 0 -1 4202560 6975 0 1 0 36 2 0 0 20 0 22 0 602927272 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28330] ppid=28321 vsize=15763688 CPUtime=3.79 cores=1,3,5,7
/proc/28325/task/28330/stat : 28330 (java) S 28321 28325 27450 0 -1 4202560 166203 0 0 0 351 28 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28332] ppid=28321 vsize=15763688 CPUtime=3.69 cores=1,3,5,7
/proc/28325/task/28332/stat : 28332 (java) S 28321 28325 27450 0 -1 4202560 164583 0 0 0 339 30 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28334] ppid=28321 vsize=15763688 CPUtime=3.71 cores=1,3,5,7
/proc/28325/task/28334/stat : 28334 (java) S 28321 28325 27450 0 -1 4202560 154303 0 0 0 341 30 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28336] ppid=28321 vsize=15763688 CPUtime=3.74 cores=1,3,5,7
/proc/28325/task/28336/stat : 28336 (java) S 28321 28325 27450 0 -1 4202560 166803 0 0 0 346 28 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28338] ppid=28321 vsize=15763688 CPUtime=3.68 cores=1,3,5,7
/proc/28325/task/28338/stat : 28338 (java) S 28321 28325 27450 0 -1 4202560 155035 0 0 0 340 28 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28340] ppid=28321 vsize=15763688 CPUtime=3.66 cores=1,3,5,7
/proc/28325/task/28340/stat : 28340 (java) S 28321 28325 27450 0 -1 4202560 162367 0 0 0 334 32 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28342] ppid=28321 vsize=15763688 CPUtime=3.7 cores=1,3,5,7
/proc/28325/task/28342/stat : 28342 (java) S 28321 28325 27450 0 -1 4202560 158204 0 0 0 340 30 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28344] ppid=28321 vsize=15763688 CPUtime=3.66 cores=1,3,5,7
/proc/28325/task/28344/stat : 28344 (java) S 28321 28325 27450 0 -1 4202560 163219 0 0 0 338 28 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28346] ppid=28321 vsize=15763688 CPUtime=2.13 cores=1,3,5,7
/proc/28325/task/28346/stat : 28346 (java) S 28321 28325 27450 0 -1 4202560 7745 0 0 0 125 88 0 0 15 0 22 0 602927274 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 0 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28348] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28348/stat : 28348 (java) S 28321 28325 27450 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602927274 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28350] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28350/stat : 28350 (java) S 28321 28325 27450 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 602927274 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28353] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28353/stat : 28353 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216747002289 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28355] ppid=28321 vsize=15763688 CPUtime=0.92 cores=1,3,5,7
/proc/28325/task/28355/stat : 28355 (java) S 28321 28325 27450 0 -1 4202560 6096 0 0 0 92 0 0 0 15 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28359] ppid=28321 vsize=15763688 CPUtime=0.98 cores=1,3,5,7
/proc/28325/task/28359/stat : 28359 (java) S 28321 28325 27450 0 -1 4202560 9956 0 0 0 97 1 0 0 15 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28360] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28360/stat : 28360 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28361] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28361/stat : 28361 (java) S 28321 28325 27450 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28362] ppid=28321 vsize=15763688 CPUtime=1192.28 cores=1,3,5,7
/proc/28325/task/28362/stat : 28362 (java) R 28321 28325 27450 0 -1 4202560 437528 0 0 0 119169 59 0 0 25 0 22 0 602927299 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505707504 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28325/tid=28363] ppid=28321 vsize=15763688 CPUtime=1191.51 cores=1,3,5,7
/proc/28325/task/28363/stat : 28363 (java) R 28321 28325 27450 0 -1 4202560 426318 0 0 0 119094 57 0 0 25 0 22 0 602927299 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912506143353 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=28325/tid=28364] ppid=28321 vsize=15763688 CPUtime=1191.02 cores=1,3,5,7
/proc/28325/task/28364/stat : 28364 (java) R 28321 28325 27450 0 -1 4202560 434790 0 0 0 119043 59 0 0 25 0 22 0 602927299 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28325/tid=28365] ppid=28321 vsize=15763688 CPUtime=1191.33 cores=1,3,5,7
/proc/28325/task/28365/stat : 28365 (java) R 28321 28325 27450 0 -1 4202560 431672 0 0 0 119073 60 0 0 25 0 22 0 602927299 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912506117354 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 15763688

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1206.6 s]
/proc/loadavg: 8.17 8.11 7.89 10/220 28404
/proc/meminfo: memFree=23702932/32951124 swapFree=67102140/67111528
[pid=28325] ppid=28321 vsize=15763688 CPUtime=4800.36 cores=1,3,5,7
/proc/28325/stat : 28325 (java) S 28321 28325 27450 0 -1 4202496 3053256 0 1 0 479467 569 0 0 17 0 22 0 602927271 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/28325/statm: 3940922 94146 2298 9 0 3931641 0
[pid=28325/tid=28328] ppid=28321 vsize=15763688 CPUtime=0.38 cores=1,3,5,7
/proc/28325/task/28328/stat : 28328 (java) S 28321 28325 27450 0 -1 4202560 6975 0 1 0 36 2 0 0 20 0 22 0 602927272 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28330] ppid=28321 vsize=15763688 CPUtime=3.79 cores=1,3,5,7
/proc/28325/task/28330/stat : 28330 (java) S 28321 28325 27450 0 -1 4202560 166203 0 0 0 351 28 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28332] ppid=28321 vsize=15763688 CPUtime=3.69 cores=1,3,5,7
/proc/28325/task/28332/stat : 28332 (java) S 28321 28325 27450 0 -1 4202560 164583 0 0 0 339 30 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28334] ppid=28321 vsize=15763688 CPUtime=3.71 cores=1,3,5,7
/proc/28325/task/28334/stat : 28334 (java) S 28321 28325 27450 0 -1 4202560 154303 0 0 0 341 30 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28336] ppid=28321 vsize=15763688 CPUtime=3.74 cores=1,3,5,7
/proc/28325/task/28336/stat : 28336 (java) S 28321 28325 27450 0 -1 4202560 166803 0 0 0 346 28 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28338] ppid=28321 vsize=15763688 CPUtime=3.68 cores=1,3,5,7
/proc/28325/task/28338/stat : 28338 (java) S 28321 28325 27450 0 -1 4202560 155035 0 0 0 340 28 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28340] ppid=28321 vsize=15763688 CPUtime=3.66 cores=1,3,5,7
/proc/28325/task/28340/stat : 28340 (java) S 28321 28325 27450 0 -1 4202560 162367 0 0 0 334 32 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28342] ppid=28321 vsize=15763688 CPUtime=3.7 cores=1,3,5,7
/proc/28325/task/28342/stat : 28342 (java) S 28321 28325 27450 0 -1 4202560 158204 0 0 0 340 30 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28344] ppid=28321 vsize=15763688 CPUtime=3.66 cores=1,3,5,7
/proc/28325/task/28344/stat : 28344 (java) S 28321 28325 27450 0 -1 4202560 163219 0 0 0 338 28 0 0 15 0 22 0 602927273 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28346] ppid=28321 vsize=15763688 CPUtime=2.13 cores=1,3,5,7
/proc/28325/task/28346/stat : 28346 (java) S 28321 28325 27450 0 -1 4202560 7745 0 0 0 125 88 0 0 15 0 22 0 602927274 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 0 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28348] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28348/stat : 28348 (java) S 28321 28325 27450 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602927274 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28350] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28350/stat : 28350 (java) S 28321 28325 27450 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 22 0 602927274 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 7 0 0 0
[pid=28325/tid=28353] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28353/stat : 28353 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216747002289 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28355] ppid=28321 vsize=15763688 CPUtime=0.92 cores=1,3,5,7
/proc/28325/task/28355/stat : 28355 (java) S 28321 28325 27450 0 -1 4202560 6096 0 0 0 92 0 0 0 15 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 3 0 0 0
[pid=28325/tid=28359] ppid=28321 vsize=15763688 CPUtime=0.98 cores=1,3,5,7
/proc/28325/task/28359/stat : 28359 (java) S 28321 28325 27450 0 -1 4202560 9956 0 0 0 97 1 0 0 15 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28360] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28360/stat : 28360 (java) S 28321 28325 27450 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746994585 0 4 0 16800975 18446604471161616256 0 0 -1 5 0 0 0
[pid=28325/tid=28361] ppid=28321 vsize=15763688 CPUtime=0 cores=1,3,5,7
/proc/28325/task/28361/stat : 28361 (java) S 28321 28325 27450 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 602927277 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 216746995200 0 4 0 16800975 18446604471161616256 0 0 -1 1 0 0 0
[pid=28325/tid=28362] ppid=28321 vsize=15763688 CPUtime=1192.28 cores=1,3,5,7
/proc/28325/task/28362/stat : 28362 (java) R 28321 28325 27450 0 -1 4202560 437528 0 0 0 119169 59 0 0 25 0 22 0 602927299 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912505707504 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=28325/tid=28363] ppid=28321 vsize=15763688 CPUtime=1191.51 cores=1,3,5,7
/proc/28325/task/28363/stat : 28363 (java) R 28321 28325 27450 0 -1 4202560 426318 0 0 0 119094 57 0 0 25 0 22 0 602927299 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912506143353 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=28325/tid=28364] ppid=28321 vsize=15763688 CPUtime=1191.02 cores=1,3,5,7
/proc/28325/task/28364/stat : 28364 (java) R 28321 28325 27450 0 -1 4202560 434790 0 0 0 119043 59 0 0 25 0 22 0 602927299 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=28325/tid=28365] ppid=28321 vsize=15763688 CPUtime=1191.33 cores=1,3,5,7
/proc/28325/task/28365/stat : 28365 (java) R 28321 28325 27450 0 -1 4202560 431672 0 0 0 119073 60 0 0 25 0 22 0 602927299 16142016512 94146 33554432000 1073741824 1073778376 140735071038656 18446744073709551615 46912506117354 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 15763688

Child status: 143
Real time (s): 1206.63
CPU time (s): 4800.42
CPU user time (s): 4794.71
CPU system time (s): 5.70913
CPU usage (%): 397.835
Max. virtual memory (cumulated for all children) (KiB): 15763688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.71
system time used= 5.70913
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3053283
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 204286
involuntary context switches= 130177

runsolver used 1.9927 second user time and 4.6333 second system time

The end

Launcher Data 

Begin job on node119 at 2011-04-30 03:29:26
IDJOB=3311431
IDBENCH=82816
IDSOLVER=1698
FILE ID=node119/3311431-1304126966
RUNJOBID= node119-1304126966-28307
PBS_JOBID= 13170728
Free space on /tmp= 71816 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v700-c2982-S628307658-028.SATISFIABLE.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311431-1304126966/watcher-3311431-1304126966 -o /tmp/evaluation-result-3311431-1304126966/solver-3311431-1304126966 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311431-1304126966.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0b3e0de9aa59dd098eea77ce3aaba6c9
RANDOM SEED=848253922

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24377236 kB
Buffers:       1917884 kB
Cached:        6034076 kB
SwapCached:       3688 kB
Active:         184040 kB
Inactive:      7827352 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24377236 kB
SwapTotal:    67111528 kB
SwapFree:     67102140 kB
Dirty:            3124 kB
Writeback:          40 kB
AnonPages:       58440 kB
Mapped:          14368 kB
Slab:           499076 kB
PageTables:       4580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188124 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71812 MiB
End job on node119 at 2011-04-30 03:49:35