Trace number 3311121

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.2 1207.05

General information on the benchmark

Namerandom/large/
unif-k7-r85-v150-c12750-S93401285-051-UNKNOWN.cnf
MD5SUMdc0028248c86c8aff67bef1f8d7ffb16
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark5.2752
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses12750
Sum of the clauses size89250
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 512750

Solver Data 

0.10/0.12	54:16 INFO : Reading from input HOME/instance-3311121-1304110456.cnf
0.52/0.38	Executor set job limit to 1000000
0.52/0.38	Executor set job limit to 1000000
0.52/0.38	Executor set job limit to 1000000
0.52/0.38	Executor set job limit to 1000000
0.52/0.38	Starting Executor!
0.52/0.38	Starting Executor!
0.52/0.38	Starting Executor!
0.52/0.38	Starting Executor!
1.12/0.68	54:17 INFO : 150 variables remaining out of 150
1.12/0.68	54:17 INFO : 102000 literals remaining out of 102000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311121-1304110456/watcher-3311121-1304110456 -o /tmp/evaluation-result-3311121-1304110456/solver-3311121-1304110456 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311121-1304110456.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.27 5.80 7.11 2/173 21236
/proc/meminfo: memFree=30606792/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=23028 CPUtime=0 cores=0,2,4,6
/proc/21236/stat : 21236 (java) R 21234 21236 21203 0 -1 4202496 1003 0 0 0 0 0 0 0 25 0 1 0 522647964 23580672 490 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212431054613 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/21236/statm: 5757 504 385 9 0 124 0

[startup+0.0450599 s]
/proc/loadavg: 3.27 5.80 7.11 2/173 21236
/proc/meminfo: memFree=30606792/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15604248 CPUtime=0.03 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 3802 0 1 0 2 1 0 0 25 0 13 0 522647964 15978749952 3242 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800971 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3901062 3243 1683 9 0 3891810 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 15604248

[startup+0.101047 s]
/proc/loadavg: 3.27 5.80 7.11 2/173 21236
/proc/meminfo: memFree=30606792/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15675980 CPUtime=0.1 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 5514 0 1 0 9 1 0 0 25 0 18 0 522647964 16052203520 4954 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3918995 4954 2117 9 0 3909714 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15675980

[startup+0.301053 s]
/proc/loadavg: 3.27 5.80 7.11 2/173 21236
/proc/meminfo: memFree=30606792/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15678184 CPUtime=0.52 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 14220 0 1 0 49 3 0 0 25 0 18 0 522647964 16054460416 12563 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3919546 12565 2207 9 0 3910265 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15678184

[startup+0.700923 s]
/proc/loadavg: 3.27 5.80 7.11 2/173 21236
/proc/meminfo: memFree=30606792/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15693420 CPUtime=1.41 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 37531 0 1 0 135 6 0 0 25 0 22 0 522647964 16070062080 33244 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3923355 33244 2248 9 0 3914074 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 15693420

[startup+1.50072 s]
/proc/loadavg: 3.27 5.80 7.11 9/220 21284
/proc/meminfo: memFree=30268448/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15766000 CPUtime=4.39 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 63721 0 1 0 430 9 0 0 25 0 22 0 522647964 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3941500 54659 2274 9 0 3932219 0
[pid=21236/tid=21239] ppid=21234 vsize=15766000 CPUtime=0.66 cores=0,2,4,6
/proc/21236/task/21239/stat : 21239 (java) S 21234 21236 21203 0 -1 4202560 23363 0 1 0 63 3 0 0 20 0 22 0 522647964 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21243] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21243/stat : 21243 (java) S 21234 21236 21203 0 -1 4202560 1576 0 0 0 0 0 0 0 16 0 22 0 522647965 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21244] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21244/stat : 21244 (java) S 21234 21236 21203 0 -1 4202560 1077 0 0 0 0 0 0 0 16 0 22 0 522647965 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21245] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21245/stat : 21245 (java) S 21234 21236 21203 0 -1 4202560 749 0 0 0 0 0 0 0 16 0 22 0 522647965 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21246] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21246/stat : 21246 (java) S 21234 21236 21203 0 -1 4202560 1471 0 0 0 0 0 0 0 16 0 22 0 522647965 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21247] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21247/stat : 21247 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522647965 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21248] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21248/stat : 21248 (java) S 21234 21236 21203 0 -1 4202560 823 0 0 0 0 0 0 0 15 0 22 0 522647965 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21249] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21249/stat : 21249 (java) S 21234 21236 21203 0 -1 4202560 820 0 0 0 0 0 0 0 15 0 22 0 522647965 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21250] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21250/stat : 21250 (java) S 21234 21236 21203 0 -1 4202560 690 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21261] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21261/stat : 21261 (java) S 21234 21236 21203 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 522647966 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 0 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21262] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21262/stat : 21262 (java) S 21234 21236 21203 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21263] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21263/stat : 21263 (java) S 21234 21236 21203 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21267] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21267/stat : 21267 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447840689 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21268] ppid=21234 vsize=15766000 CPUtime=0.73 cores=0,2,4,6
/proc/21236/task/21268/stat : 21268 (java) S 21234 21236 21203 0 -1 4202560 6862 0 0 0 72 1 0 0 15 0 22 0 522647969 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21269] ppid=21234 vsize=15766000 CPUtime=0.91 cores=0,2,4,6
/proc/21236/task/21269/stat : 21269 (java) S 21234 21236 21203 0 -1 4202560 12497 0 0 0 90 1 0 0 15 0 22 0 522647969 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21270] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21270/stat : 21270 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21271] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21271/stat : 21271 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522647969 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21277] ppid=21234 vsize=15766000 CPUtime=0.41 cores=0,2,4,6
/proc/21236/task/21277/stat : 21277 (java) R 21234 21236 21203 0 -1 4202560 1408 0 0 0 41 0 0 0 16 0 22 0 522648002 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505859464 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=21236/tid=21278] ppid=21234 vsize=15766000 CPUtime=0.58 cores=0,2,4,6
/proc/21236/task/21278/stat : 21278 (java) R 21234 21236 21203 0 -1 4202560 5524 0 0 0 58 0 0 0 17 0 22 0 522648002 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505943494 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=21236/tid=21279] ppid=21234 vsize=15766000 CPUtime=0.72 cores=0,2,4,6
/proc/21236/task/21279/stat : 21279 (java) R 21234 21236 21203 0 -1 4202560 5387 0 0 0 72 0 0 0 16 0 22 0 522648002 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505764226 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=21236/tid=21280] ppid=21234 vsize=15766000 CPUtime=0.27 cores=0,2,4,6
/proc/21236/task/21280/stat : 21280 (java) R 21234 21236 21203 0 -1 4202560 14 0 0 0 27 0 0 0 16 0 22 0 522648002 16144384000 54659 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505764209 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.39
Current children cumulated vsize (KiB) 15766000

[startup+3.10141 s]
/proc/loadavg: 3.27 5.80 7.11 10/220 21284
/proc/meminfo: memFree=29876992/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15766000 CPUtime=10.78 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 160643 0 1 0 1055 23 0 0 25 0 22 0 522647964 16144384000 151555 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3941500 151561 2284 9 0 3932219 0
[pid=21236/tid=21239] ppid=21234 vsize=15766000 CPUtime=0.66 cores=0,2,4,6
/proc/21236/task/21239/stat : 21239 (java) S 21234 21236 21203 0 -1 4202560 23363 0 1 0 63 3 0 0 20 0 22 0 522647964 16144384000 151563 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21243] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21243/stat : 21243 (java) S 21234 21236 21203 0 -1 4202560 5219 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 151570 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21244] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21244/stat : 21244 (java) S 21234 21236 21203 0 -1 4202560 2784 0 0 0 0 0 0 0 16 0 22 0 522647965 16144384000 151583 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21245] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21245/stat : 21245 (java) S 21234 21236 21203 0 -1 4202560 3125 0 0 0 0 0 0 0 15 0 22 0 522647965 16144384000 151592 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21246] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21246/stat : 21246 (java) S 21234 21236 21203 0 -1 4202560 3957 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 151599 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21247] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21247/stat : 21247 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522647965 16144384000 151605 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21248] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21248/stat : 21248 (java) S 21234 21236 21203 0 -1 4202560 2663 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 151611 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21249] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21249/stat : 21249 (java) S 21234 21236 21203 0 -1 4202560 3130 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 151616 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21250] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21250/stat : 21250 (java) S 21234 21236 21203 0 -1 4202560 2206 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 151621 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21261] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21261/stat : 21261 (java) S 21234 21236 21203 0 -1 4202560 200 0 0 0 0 0 0 0 15 0 22 0 522647966 16144384000 151626 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 0 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21262] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21262/stat : 21262 (java) S 21234 21236 21203 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 151631 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21263] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21263/stat : 21263 (java) S 21234 21236 21203 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 151637 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21267] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21267/stat : 21267 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 151643 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447840689 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21268] ppid=21234 vsize=15766000 CPUtime=0.84 cores=0,2,4,6
/proc/21236/task/21268/stat : 21268 (java) S 21234 21236 21203 0 -1 4202560 6944 0 0 0 83 1 0 0 16 0 22 0 522647969 16144384000 151648 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21269] ppid=21234 vsize=15766000 CPUtime=1.03 cores=0,2,4,6
/proc/21236/task/21269/stat : 21269 (java) S 21234 21236 21203 0 -1 4202560 12521 0 0 0 102 1 0 0 15 0 22 0 522647969 16144384000 151653 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21270] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21270/stat : 21270 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 151657 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21271] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21271/stat : 21271 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522647969 16144384000 151663 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21277] ppid=21234 vsize=15766000 CPUtime=1.98 cores=0,2,4,6
/proc/21236/task/21277/stat : 21277 (java) R 21234 21236 21203 0 -1 4202560 21414 0 0 0 196 2 0 0 17 0 22 0 522648002 16144384000 151667 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505859761 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=21236/tid=21278] ppid=21234 vsize=15766000 CPUtime=2.05 cores=0,2,4,6
/proc/21236/task/21278/stat : 21278 (java) R 21234 21236 21203 0 -1 4202560 25502 0 0 0 202 3 0 0 18 0 22 0 522648002 16144384000 151671 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505820023 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=21236/tid=21279] ppid=21234 vsize=15766000 CPUtime=2.26 cores=0,2,4,6
/proc/21236/task/21279/stat : 21279 (java) R 21234 21236 21203 0 -1 4202560 25435 0 0 0 224 2 0 0 17 0 22 0 522648002 16144384000 151675 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505820023 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=21236/tid=21280] ppid=21234 vsize=15766000 CPUtime=1.75 cores=0,2,4,6
/proc/21236/task/21280/stat : 21280 (java) R 21234 21236 21203 0 -1 4202560 20914 0 0 0 173 2 0 0 17 0 22 0 522648002 16144384000 151679 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505858826 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.78
Current children cumulated vsize (KiB) 15766000

[startup+6.30081 s]
/proc/loadavg: 3.73 5.85 7.12 9/220 21284
/proc/meminfo: memFree=28616160/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15766000 CPUtime=23.53 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 297582 0 1 0 2312 41 0 0 25 0 22 0 522647964 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3941500 288440 2284 9 0 3932219 0
[pid=21236/tid=21239] ppid=21234 vsize=15766000 CPUtime=0.66 cores=0,2,4,6
/proc/21236/task/21239/stat : 21239 (java) S 21234 21236 21203 0 -1 4202560 23363 0 1 0 63 3 0 0 20 0 22 0 522647964 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21243] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21243/stat : 21243 (java) S 21234 21236 21203 0 -1 4202560 5220 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21244] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21244/stat : 21244 (java) S 21234 21236 21203 0 -1 4202560 5158 0 0 0 1 0 0 0 16 0 22 0 522647965 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21245] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21245/stat : 21245 (java) S 21234 21236 21203 0 -1 4202560 4694 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21246] ppid=21234 vsize=15766000 CPUtime=0.02 cores=0,2,4,6
/proc/21236/task/21246/stat : 21246 (java) S 21234 21236 21203 0 -1 4202560 8607 0 0 0 1 1 0 0 16 0 22 0 522647965 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21247] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21247/stat : 21247 (java) S 21234 21236 21203 0 -1 4202560 1594 0 0 0 0 0 0 0 15 0 22 0 522647965 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21248] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21248/stat : 21248 (java) S 21234 21236 21203 0 -1 4202560 3930 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21249] ppid=21234 vsize=15766000 CPUtime=0.03 cores=0,2,4,6
/proc/21236/task/21249/stat : 21249 (java) S 21234 21236 21203 0 -1 4202560 6038 0 0 0 2 1 0 0 15 0 22 0 522647965 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21250] ppid=21234 vsize=15766000 CPUtime=0.01 cores=0,2,4,6
/proc/21236/task/21250/stat : 21250 (java) S 21234 21236 21203 0 -1 4202560 3937 0 0 0 1 0 0 0 15 0 22 0 522647965 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21261] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21261/stat : 21261 (java) S 21234 21236 21203 0 -1 4202560 970 0 0 0 0 0 0 0 15 0 22 0 522647966 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 0 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21262] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21262/stat : 21262 (java) S 21234 21236 21203 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21263] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21263/stat : 21263 (java) S 21234 21236 21203 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21267] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21267/stat : 21267 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447840689 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21268] ppid=21234 vsize=15766000 CPUtime=1.01 cores=0,2,4,6
/proc/21236/task/21268/stat : 21268 (java) S 21234 21236 21203 0 -1 4202560 7008 0 0 0 100 1 0 0 15 0 22 0 522647969 16144384000 288440 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=21236/tid=21278] ppid=21234 vsize=15766000 CPUtime=1048.82 cores=0,2,4,6
/proc/21236/task/21278/stat : 21278 (java) R 21234 21236 21203 0 -1 4202560 163527 0 0 0 104852 30 0 0 25 0 22 0 522648002 16144384000 83547 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 47406623699099 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=21236/tid=21279] ppid=21234 vsize=15766000 CPUtime=1049.79 cores=0,2,4,6
/proc/21236/task/21279/stat : 21279 (java) R 21234 21236 21203 0 -1 4202560 166010 0 0 0 104950 29 0 0 25 0 22 0 522648002 16144384000 83547 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 18446744073699065947 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=21236/tid=21280] ppid=21234 vsize=15766000 CPUtime=1047.98 cores=0,2,4,6
/proc/21236/task/21280/stat : 21280 (java) R 21234 21236 21203 0 -1 4202560 160262 0 0 0 104771 27 0 0 25 0 22 0 522648002 16144384000 83547 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505716808 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4224.59
Current children cumulated vsize (KiB) 15766000

[startup+1122.3 s]
/proc/loadavg: 8.07 8.04 7.77 9/220 21326
/proc/meminfo: memFree=29901024/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15766000 CPUtime=4463.23 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 1377568 0 1 0 445985 338 0 0 25 0 22 0 522647964 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3941500 88249 2299 9 0 3932219 0
[pid=21236/tid=21239] ppid=21234 vsize=15766000 CPUtime=0.66 cores=0,2,4,6
/proc/21236/task/21239/stat : 21239 (java) S 21234 21236 21203 0 -1 4202560 23363 0 1 0 63 3 0 0 20 0 22 0 522647964 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21243] ppid=21234 vsize=15766000 CPUtime=3.21 cores=0,2,4,6
/proc/21236/task/21243/stat : 21243 (java) S 21234 21236 21203 0 -1 4202560 76961 0 0 0 305 16 0 0 16 0 22 0 522647965 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21244] ppid=21234 vsize=15766000 CPUtime=3.2 cores=0,2,4,6
/proc/21236/task/21244/stat : 21244 (java) S 21234 21236 21203 0 -1 4202560 83642 0 0 0 303 17 0 0 15 0 22 0 522647965 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21245] ppid=21234 vsize=15766000 CPUtime=3.19 cores=0,2,4,6
/proc/21236/task/21245/stat : 21245 (java) S 21234 21236 21203 0 -1 4202560 79233 0 0 0 301 18 0 0 15 0 22 0 522647965 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21246] ppid=21234 vsize=15766000 CPUtime=3.14 cores=0,2,4,6
/proc/21236/task/21246/stat : 21246 (java) S 21234 21236 21203 0 -1 4202560 80971 0 0 0 294 20 0 0 15 0 22 0 522647965 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21247] ppid=21234 vsize=15766000 CPUtime=3.16 cores=0,2,4,6
/proc/21236/task/21247/stat : 21247 (java) S 21234 21236 21203 0 -1 4202560 79035 0 0 0 301 15 0 0 15 0 22 0 522647965 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21248] ppid=21234 vsize=15766000 CPUtime=3.21 cores=0,2,4,6
/proc/21236/task/21248/stat : 21248 (java) S 21234 21236 21203 0 -1 4202560 83922 0 0 0 304 17 0 0 16 0 22 0 522647965 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21249] ppid=21234 vsize=15766000 CPUtime=3.28 cores=0,2,4,6
/proc/21236/task/21249/stat : 21249 (java) S 21234 21236 21203 0 -1 4202560 83710 0 0 0 311 17 0 0 15 0 22 0 522647965 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21250] ppid=21234 vsize=15766000 CPUtime=3.15 cores=0,2,4,6
/proc/21236/task/21250/stat : 21250 (java) S 21234 21236 21203 0 -1 4202560 76834 0 0 0 297 18 0 0 16 0 22 0 522647965 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21261] ppid=21234 vsize=15766000 CPUtime=1.92 cores=0,2,4,6
/proc/21236/task/21261/stat : 21261 (java) S 21234 21236 21203 0 -1 4202560 3370 0 0 0 131 61 0 0 16 0 22 0 522647966 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 0 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21262] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21262/stat : 21262 (java) S 21234 21236 21203 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21263] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21263/stat : 21263 (java) S 21234 21236 21203 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21267] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21267/stat : 21267 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447840689 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21268] ppid=21234 vsize=15766000 CPUtime=1.05 cores=0,2,4,6
/proc/21236/task/21268/stat : 21268 (java) S 21234 21236 21203 0 -1 4202560 7015 0 0 0 104 1 0 0 15 0 22 0 522647969 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21269] ppid=21234 vsize=15766000 CPUtime=1.15 cores=0,2,4,6
/proc/21236/task/21269/stat : 21269 (java) S 21234 21236 21203 0 -1 4202560 12534 0 0 0 114 1 0 0 15 0 22 0 522647969 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21270] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21270/stat : 21270 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21271] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21271/stat : 21271 (java) S 21234 21236 21203 0 -1 4202560 59 0 0 0 0 0 0 0 15 0 22 0 522647969 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21277] ppid=21234 vsize=15766000 CPUtime=1108.15 cores=0,2,4,6
/proc/21236/task/21277/stat : 21277 (java) R 21234 21236 21203 0 -1 4202560 168895 0 0 0 110782 33 0 0 25 0 22 0 522648002 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505620909 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=21236/tid=21278] ppid=21234 vsize=15766000 CPUtime=1108.15 cores=0,2,4,6
/proc/21236/task/21278/stat : 21278 (java) R 21234 21236 21203 0 -1 4202560 172270 0 0 0 110783 32 0 0 25 0 22 0 522648002 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505858389 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=21236/tid=21279] ppid=21234 vsize=15766000 CPUtime=1109.11 cores=0,2,4,6
/proc/21236/task/21279/stat : 21279 (java) R 21234 21236 21203 0 -1 4202560 175278 0 0 0 110881 30 0 0 25 0 22 0 522648002 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505561312 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=21236/tid=21280] ppid=21234 vsize=15766000 CPUtime=1107.32 cores=0,2,4,6
/proc/21236/task/21280/stat : 21280 (java) R 21234 21236 21203 0 -1 4202560 169092 0 0 0 110703 29 0 0 25 0 22 0 522648002 16144384000 88249 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505737272 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4463.23
Current children cumulated vsize (KiB) 15766000

[startup+1182.3 s]
/proc/loadavg: 8.14 8.06 7.79 9/220 21327
/proc/meminfo: memFree=29888528/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15766000 CPUtime=4701.87 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 1451264 0 1 0 469830 357 0 0 25 0 22 0 522647964 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3941500 88520 2299 9 0 3932219 0
[pid=21236/tid=21239] ppid=21234 vsize=15766000 CPUtime=0.66 cores=0,2,4,6
/proc/21236/task/21239/stat : 21239 (java) S 21234 21236 21203 0 -1 4202560 23363 0 1 0 63 3 0 0 20 0 22 0 522647964 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21243] ppid=21234 vsize=15766000 CPUtime=3.36 cores=0,2,4,6
/proc/21236/task/21243/stat : 21243 (java) S 21234 21236 21203 0 -1 4202560 80221 0 0 0 319 17 0 0 15 0 22 0 522647965 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21244] ppid=21234 vsize=15766000 CPUtime=3.36 cores=0,2,4,6
/proc/21236/task/21244/stat : 21244 (java) S 21234 21236 21203 0 -1 4202560 86957 0 0 0 318 18 0 0 15 0 22 0 522647965 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21245] ppid=21234 vsize=15766000 CPUtime=3.37 cores=0,2,4,6
/proc/21236/task/21245/stat : 21245 (java) S 21234 21236 21203 0 -1 4202560 83235 0 0 0 318 19 0 0 16 0 22 0 522647965 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21246] ppid=21234 vsize=15766000 CPUtime=3.3 cores=0,2,4,6
/proc/21236/task/21246/stat : 21246 (java) S 21234 21236 21203 0 -1 4202560 85506 0 0 0 309 21 0 0 15 0 22 0 522647965 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21247] ppid=21234 vsize=15766000 CPUtime=3.34 cores=0,2,4,6
/proc/21236/task/21247/stat : 21247 (java) S 21234 21236 21203 0 -1 4202560 83006 0 0 0 318 16 0 0 15 0 22 0 522647965 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21248] ppid=21234 vsize=15766000 CPUtime=3.35 cores=0,2,4,6
/proc/21236/task/21248/stat : 21248 (java) S 21234 21236 21203 0 -1 4202560 87334 0 0 0 317 18 0 0 15 0 22 0 522647965 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21249] ppid=21234 vsize=15766000 CPUtime=3.45 cores=0,2,4,6
/proc/21236/task/21249/stat : 21249 (java) S 21234 21236 21203 0 -1 4202560 87570 0 0 0 327 18 0 0 16 0 22 0 522647965 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21250] ppid=21234 vsize=15766000 CPUtime=3.33 cores=0,2,4,6
/proc/21236/task/21250/stat : 21250 (java) S 21234 21236 21203 0 -1 4202560 81568 0 0 0 313 20 0 0 16 0 22 0 522647965 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21261] ppid=21234 vsize=15766000 CPUtime=2.05 cores=0,2,4,6
/proc/21236/task/21261/stat : 21261 (java) S 21234 21236 21203 0 -1 4202560 3580 0 0 0 140 65 0 0 16 0 22 0 522647966 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 0 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21262] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21262/stat : 21262 (java) S 21234 21236 21203 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21263] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21263/stat : 21263 (java) S 21234 21236 21203 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21267] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21267/stat : 21267 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447840689 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21268] ppid=21234 vsize=15766000 CPUtime=1.05 cores=0,2,4,6
/proc/21236/task/21268/stat : 21268 (java) S 21234 21236 21203 0 -1 4202560 7015 0 0 0 104 1 0 0 15 0 22 0 522647969 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21269] ppid=21234 vsize=15766000 CPUtime=1.15 cores=0,2,4,6
/proc/21236/task/21269/stat : 21269 (java) S 21234 21236 21203 0 -1 4202560 12534 0 0 0 114 1 0 0 15 0 22 0 522647969 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21270] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21270/stat : 21270 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21271] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21271/stat : 21271 (java) S 21234 21236 21203 0 -1 4202560 63 0 0 0 0 0 0 0 15 0 22 0 522647969 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21277] ppid=21234 vsize=15766000 CPUtime=1167.52 cores=0,2,4,6
/proc/21236/task/21277/stat : 21277 (java) R 21234 21236 21203 0 -1 4202560 179301 0 0 0 116717 35 0 0 25 0 22 0 522648002 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505858215 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=21236/tid=21278] ppid=21234 vsize=15766000 CPUtime=1167.5 cores=0,2,4,6
/proc/21236/task/21278/stat : 21278 (java) R 21234 21236 21203 0 -1 4202560 183094 0 0 0 116717 33 0 0 25 0 22 0 522648002 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505859836 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=21236/tid=21279] ppid=21234 vsize=15766000 CPUtime=1168.45 cores=0,2,4,6
/proc/21236/task/21279/stat : 21279 (java) R 21234 21236 21203 0 -1 4202560 186272 0 0 0 116813 32 0 0 25 0 22 0 522648002 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912506005502 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=21236/tid=21280] ppid=21234 vsize=15766000 CPUtime=1166.46 cores=0,2,4,6
/proc/21236/task/21280/stat : 21280 (java) R 21234 21236 21203 0 -1 4202560 179261 0 0 0 116615 31 0 0 25 0 22 0 522648002 16144384000 88520 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505820312 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4701.87
Current children cumulated vsize (KiB) 15766000



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207 s]
/proc/loadavg: 8.09 8.05 7.80 9/220 21328
/proc/meminfo: memFree=29889728/32951124 swapFree=67111416/67111528
[pid=21236] ppid=21234 vsize=15766000 CPUtime=4800.07 cores=0,2,4,6
/proc/21236/stat : 21236 (java) S 21234 21236 21203 0 -1 4202496 1481009 0 1 0 479644 363 0 0 25 0 22 0 522647964 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/21236/statm: 3941500 84435 2299 9 0 3932219 0
[pid=21236/tid=21239] ppid=21234 vsize=15766000 CPUtime=0.66 cores=0,2,4,6
/proc/21236/task/21239/stat : 21239 (java) S 21234 21236 21203 0 -1 4202560 23363 0 1 0 63 3 0 0 20 0 22 0 522647964 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21243] ppid=21234 vsize=15766000 CPUtime=3.43 cores=0,2,4,6
/proc/21236/task/21243/stat : 21243 (java) S 21234 21236 21203 0 -1 4202560 80762 0 0 0 326 17 0 0 16 0 22 0 522647965 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21244] ppid=21234 vsize=15766000 CPUtime=3.42 cores=0,2,4,6
/proc/21236/task/21244/stat : 21244 (java) S 21234 21236 21203 0 -1 4202560 87964 0 0 0 324 18 0 0 16 0 22 0 522647965 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21245] ppid=21234 vsize=15766000 CPUtime=3.43 cores=0,2,4,6
/proc/21236/task/21245/stat : 21245 (java) S 21234 21236 21203 0 -1 4202560 84296 0 0 0 324 19 0 0 15 0 22 0 522647965 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21246] ppid=21234 vsize=15766000 CPUtime=3.37 cores=0,2,4,6
/proc/21236/task/21246/stat : 21246 (java) S 21234 21236 21203 0 -1 4202560 86532 0 0 0 316 21 0 0 15 0 22 0 522647965 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21247] ppid=21234 vsize=15766000 CPUtime=3.39 cores=0,2,4,6
/proc/21236/task/21247/stat : 21247 (java) S 21234 21236 21203 0 -1 4202560 83709 0 0 0 323 16 0 0 15 0 22 0 522647965 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21248] ppid=21234 vsize=15766000 CPUtime=3.42 cores=0,2,4,6
/proc/21236/task/21248/stat : 21248 (java) S 21234 21236 21203 0 -1 4202560 88182 0 0 0 323 19 0 0 15 0 22 0 522647965 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21249] ppid=21234 vsize=15766000 CPUtime=3.52 cores=0,2,4,6
/proc/21236/task/21249/stat : 21249 (java) S 21234 21236 21203 0 -1 4202560 88402 0 0 0 334 18 0 0 15 0 22 0 522647965 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 0 0 0 0
[pid=21236/tid=21250] ppid=21234 vsize=15766000 CPUtime=3.39 cores=0,2,4,6
/proc/21236/task/21250/stat : 21250 (java) S 21234 21236 21203 0 -1 4202560 82314 0 0 0 319 20 0 0 15 0 22 0 522647965 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21261] ppid=21234 vsize=15766000 CPUtime=2.1 cores=0,2,4,6
/proc/21236/task/21261/stat : 21261 (java) S 21234 21236 21203 0 -1 4202560 3675 0 0 0 144 66 0 0 15 0 22 0 522647966 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 0 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21262] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21262/stat : 21262 (java) S 21234 21236 21203 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21263] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21263/stat : 21263 (java) S 21234 21236 21203 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522647967 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 6 0 0 0
[pid=21236/tid=21267] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21267/stat : 21267 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447840689 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21268] ppid=21234 vsize=15766000 CPUtime=1.05 cores=0,2,4,6
/proc/21236/task/21268/stat : 21268 (java) S 21234 21236 21203 0 -1 4202560 7015 0 0 0 104 1 0 0 15 0 22 0 522647969 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21269] ppid=21234 vsize=15766000 CPUtime=1.15 cores=0,2,4,6
/proc/21236/task/21269/stat : 21269 (java) S 21234 21236 21203 0 -1 4202560 12534 0 0 0 114 1 0 0 15 0 22 0 522647969 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21270] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21270/stat : 21270 (java) S 21234 21236 21203 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522647969 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447832985 0 4 0 16800975 18446604453946202304 0 0 -1 2 0 0 0
[pid=21236/tid=21271] ppid=21234 vsize=15766000 CPUtime=0 cores=0,2,4,6
/proc/21236/task/21271/stat : 21271 (java) S 21234 21236 21203 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 522647969 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 212447833600 0 4 0 16800975 18446604453946202304 0 0 -1 4 0 0 0
[pid=21236/tid=21277] ppid=21234 vsize=15766000 CPUtime=1191.94 cores=0,2,4,6
/proc/21236/task/21277/stat : 21277 (java) R 21234 21236 21203 0 -1 4202560 185042 0 0 0 119159 35 0 0 25 0 22 0 522648002 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 47406623699138 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=21236/tid=21278] ppid=21234 vsize=15766000 CPUtime=1191.9 cores=0,2,4,6
/proc/21236/task/21278/stat : 21278 (java) R 21234 21236 21203 0 -1 4202560 188341 0 0 0 119156 34 0 0 25 0 22 0 522648002 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505820552 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=21236/tid=21279] ppid=21234 vsize=15766000 CPUtime=1192.9 cores=0,2,4,6
/proc/21236/task/21279/stat : 21279 (java) R 21234 21236 21203 0 -1 4202560 192215 0 0 0 119257 33 0 0 25 0 22 0 522648002 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505943309 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=21236/tid=21280] ppid=21234 vsize=15766000 CPUtime=1190.82 cores=0,2,4,6
/proc/21236/task/21280/stat : 21280 (java) R 21234 21236 21203 0 -1 4202560 185214 0 0 0 119050 32 0 0 25 0 22 0 522648002 16144384000 84435 33554432000 1073741824 1073778376 140736466870224 18446744073709551615 46912505943345 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.07
Current children cumulated vsize (KiB) 15766000

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1207.05
CPU time (s): 4800.2
CPU user time (s): 4796.55
CPU system time (s): 3.65644
CPU usage (%): 397.68
Max. virtual memory (cumulated for all children) (KiB): 15766000

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.55
system time used= 3.65644
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1481035
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 254705
involuntary context switches= 135587

runsolver used 1.9427 second user time and 4.70228 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-29 22:54:16
IDJOB=3311121
IDBENCH=82506
IDSOLVER=1698
FILE ID=node102/3311121-1304110456
RUNJOBID= node102-1304110456-21221
PBS_JOBID= 13170678
Free space on /tmp= 71560 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/large/unif-k7-r85-v150-c12750-S93401285-051-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311121-1304110456/watcher-3311121-1304110456 -o /tmp/evaluation-result-3311121-1304110456/solver-3311121-1304110456 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311121-1304110456.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dc0028248c86c8aff67bef1f8d7ffb16
RANDOM SEED=1169922019

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30607420 kB
Buffers:        600452 kB
Cached:        1262008 kB
SwapCached:          0 kB
Active:         133820 kB
Inactive:      1792412 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30607420 kB
SwapTotal:    67111528 kB
SwapFree:     67111416 kB
Dirty:            2712 kB
Writeback:           0 kB
AnonPages:       64660 kB
Mapped:          14476 kB
Slab:           351852 kB
PageTables:       4560 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187064 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71556 MiB
End job on node102 at 2011-04-29 23:14:25