Trace number 3312138

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4625.83 1300.58

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UCG-15-10p1.cnf
MD5SUM484dad50fb275faff8eff92c4d5447cb
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark250.24
Satisfiable
(Un)Satisfiability was proved
Number of variables200003
Number of clauses1019221
Sum of the clauses size2431032
Maximum clause length10
Minimum clause length1
Number of clauses of size 110249
Number of clauses of size 2759013
Number of clauses of size 3198999
Number of clauses of size 45660
Number of clauses of size 522640
Number of clauses of size over 522660

Solver Data

0.10/0.12	46:22 INFO : Reading from input HOME/instance-3312138-1304077581.cnf
3.86/3.58	Executor set job limit to 1000000
3.86/3.59	Executor set job limit to 1000000
3.86/3.59	Executor set job limit to 1000000
3.86/3.59	Executor set job limit to 1000000
3.86/3.59	Starting Executor!
3.86/3.59	Starting Executor!
3.86/3.59	Starting Executor!
3.86/3.59	Starting Executor!
83.94/81.48	47:43 INFO : 134912 variables remaining out of 200003
83.94/81.48	47:43 INFO : 22671238 literals remaining out of 3450253

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312138-1304077581/watcher-3312138-1304077581 -o /tmp/evaluation-result-3312138-1304077581/solver-3312138-1304077581 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312138-1304077581.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.46 4.24 5.68 5/194 15233
/proc/meminfo: memFree=30694468/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=26088 CPUtime=0 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 1399 0 0 0 0 0 0 0 22 0 2 0 519357989 26714112 870 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 6522 879 673 9 0 381 0
[pid=15233/tid=15234] ppid=15231 vsize=26088 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) R 15231 15233 14691 0 -1 4202560 56 0 0 0 0 0 0 0 24 0 2 0 519357989 26714112 885 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248084774535 0 0 4096 0 0 0 0 -1 4 0 0 0

[startup+0.054107 s]
/proc/loadavg: 3.46 4.24 5.68 5/194 15233
/proc/meminfo: memFree=30694468/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15609648 CPUtime=0.05 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 4165 0 1 0 4 1 0 0 22 0 18 0 519357989 15984279552 3604 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3902445 3606 1755 9 0 3893164 0
[pid=15233/tid=15234] ppid=15231 vsize=15609780 CPUtime=0.04 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) R 15231 15233 14691 0 -1 4202560 2751 0 1 0 4 0 0 0 25 0 18 0 519357989 15984414720 3608 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 47808660206339 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 15609648

[startup+0.101099 s]
/proc/loadavg: 3.46 4.24 5.68 5/194 15233
/proc/meminfo: memFree=30694468/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15677004 CPUtime=0.1 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 5587 0 1 0 9 1 0 0 22 0 18 0 519357989 16053252096 5000 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3919251 5000 2116 9 0 3909970 0
[pid=15233/tid=15234] ppid=15231 vsize=15677004 CPUtime=0.09 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) R 15231 15233 14691 0 -1 4202560 3445 0 1 0 8 1 0 0 18 0 18 0 519357989 16053252096 5001 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 47808663266810 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15677004

[startup+0.301095 s]
/proc/loadavg: 3.46 4.24 5.68 5/194 15233
/proc/meminfo: memFree=30694468/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15680136 CPUtime=0.54 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 15339 0 1 0 51 3 0 0 22 0 18 0 519357989 16056459264 13813 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3920034 13819 2206 9 0 3910753 0
[pid=15233/tid=15234] ppid=15231 vsize=15680136 CPUtime=0.29 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) R 15231 15233 14691 0 -1 4202560 10265 0 1 0 27 2 0 0 18 0 18 0 519357989 16056459264 13822 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505642195 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.54
Current children cumulated vsize (KiB) 15680136

[startup+0.70107 s]
/proc/loadavg: 3.46 4.24 5.68 5/194 15233
/proc/meminfo: memFree=30694468/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15680136 CPUtime=0.94 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 42121 0 1 0 88 6 0 0 22 0 18 0 519357989 16056459264 40592 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3920034 40592 2222 9 0 3910753 0
[pid=15233/tid=15234] ppid=15231 vsize=15680136 CPUtime=0.68 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) R 15231 15233 14691 0 -1 4202560 35533 0 1 0 63 5 0 0 18 0 18 0 519357989 16056459264 40592 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505570934 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.94
Current children cumulated vsize (KiB) 15680136

[startup+1.50092 s]
/proc/loadavg: 3.46 4.24 5.68 3/212 15251
/proc/meminfo: memFree=30298320/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15680136 CPUtime=1.76 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 48032 0 1 0 168 8 0 0 22 0 18 0 519357989 16056459264 46485 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3920034 46491 2222 9 0 3910753 0
[pid=15233/tid=15234] ppid=15231 vsize=15680136 CPUtime=1.47 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) R 15231 15233 14691 0 -1 4202560 38232 0 1 0 141 6 0 0 19 0 18 0 519357989 16056459264 46493 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505642353 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=15233/tid=15236] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15236/stat : 15236 (java) S 15231 15233 14691 0 -1 4202560 69 0 0 0 0 0 0 0 16 0 18 0 519357990 16056459264 46497 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15237] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15237/stat : 15237 (java) S 15231 15233 14691 0 -1 4202560 1305 0 0 0 0 0 0 0 16 0 18 0 519357990 16056459264 46501 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15238] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15238/stat : 15238 (java) S 15231 15233 14691 0 -1 4202560 12 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 46505 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15239] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15239/stat : 15239 (java) S 15231 15233 14691 0 -1 4202560 1223 0 0 0 0 0 0 0 16 0 18 0 519357990 16056459264 46509 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15240] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15240/stat : 15240 (java) S 15231 15233 14691 0 -1 4202560 700 0 0 0 0 0 0 0 16 0 18 0 519357990 16056459264 46513 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15241] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15241/stat : 15241 (java) S 15231 15233 14691 0 -1 4202560 700 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 46517 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15242] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15242/stat : 15242 (java) S 15231 15233 14691 0 -1 4202560 399 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 46521 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15243] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15243/stat : 15243 (java) S 15231 15233 14691 0 -1 4202560 252 0 0 0 0 0 0 0 16 0 18 0 519357990 16056459264 46524 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15244] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15244/stat : 15244 (java) S 15231 15233 14691 0 -1 4202560 72 0 0 0 0 0 0 0 15 0 18 0 519357991 16056459264 46527 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 0 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15245] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15245/stat : 15245 (java) S 15231 15233 14691 0 -1 4202560 18 0 0 0 0 0 0 0 21 0 18 0 519357991 16056459264 46531 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15246] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15246/stat : 15246 (java) S 15231 15233 14691 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 18 0 519357991 16056459264 46535 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15247] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15247/stat : 15247 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 519357993 16056459264 46539 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101521841 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15248] ppid=15231 vsize=15680136 CPUtime=0.13 cores=0,2,4,6
/proc/15233/task/15248/stat : 15248 (java) S 15231 15233 14691 0 -1 4202560 2358 0 0 0 13 0 0 0 15 0 18 0 519357993 16056459264 46542 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15249] ppid=15231 vsize=15680136 CPUtime=0.1 cores=0,2,4,6
/proc/15233/task/15249/stat : 15249 (java) S 15231 15233 14691 0 -1 4202560 1332 0 0 0 10 0 0 0 17 0 18 0 519357993 16056459264 46546 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15250] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15250/stat : 15250 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 519357993 16056459264 46550 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15251] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15251/stat : 15251 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 519357993 16056459264 46554 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.76
Current children cumulated vsize (KiB) 15680136

[startup+3.10152 s]
/proc/loadavg: 3.35 4.20 5.66 5/212 15251
/proc/meminfo: memFree=29889864/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15680136 CPUtime=3.42 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 139932 0 1 0 324 18 0 0 22 0 18 0 519357989 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3920034 138376 2240 9 0 3910753 0
[pid=15233/tid=15234] ppid=15231 vsize=15680136 CPUtime=3.06 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) R 15231 15233 14691 0 -1 4202560 127108 0 1 0 290 16 0 0 23 0 18 0 519357989 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505557164 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=15233/tid=15236] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15236/stat : 15236 (java) S 15231 15233 14691 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15237] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15237/stat : 15237 (java) S 15231 15233 14691 0 -1 4202560 1306 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15238] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15238/stat : 15238 (java) S 15231 15233 14691 0 -1 4202560 14 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15239] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15239/stat : 15239 (java) S 15231 15233 14691 0 -1 4202560 1223 0 0 0 0 0 0 0 16 0 18 0 519357990 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15240] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15240/stat : 15240 (java) S 15231 15233 14691 0 -1 4202560 3461 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15241] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15241/stat : 15241 (java) S 15231 15233 14691 0 -1 4202560 765 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15242] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15242/stat : 15242 (java) S 15231 15233 14691 0 -1 4202560 399 0 0 0 0 0 0 0 16 0 18 0 519357990 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15243] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15243/stat : 15243 (java) S 15231 15233 14691 0 -1 4202560 252 0 0 0 0 0 0 0 15 0 18 0 519357990 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15244] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15244/stat : 15244 (java) S 15231 15233 14691 0 -1 4202560 198 0 0 0 0 0 0 0 15 0 18 0 519357991 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 0 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15245] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15245/stat : 15245 (java) S 15231 15233 14691 0 -1 4202560 18 0 0 0 0 0 0 0 21 0 18 0 519357991 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15246] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15246/stat : 15246 (java) S 15231 15233 14691 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 18 0 519357991 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15247] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15247/stat : 15247 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 519357993 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101521841 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15248] ppid=15231 vsize=15680136 CPUtime=0.16 cores=0,2,4,6
/proc/15233/task/15248/stat : 15248 (java) S 15231 15233 14691 0 -1 4202560 2394 0 0 0 16 0 0 0 16 0 18 0 519357993 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15249] ppid=15231 vsize=15680136 CPUtime=0.12 cores=0,2,4,6
/proc/15233/task/15249/stat : 15249 (java) S 15231 15233 14691 0 -1 4202560 1356 0 0 0 12 0 0 0 15 0 18 0 519357993 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15250] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15250/stat : 15250 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 519357993 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15251] ppid=15231 vsize=15680136 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15251/stat : 15251 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 519357993 16056459264 138376 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3.42
Current children cumulated vsize (KiB) 15680136

[startup+6.3057 s]
/proc/loadavg: 3.35 4.20 5.66 3/220 15259
/proc/meminfo: memFree=29565548/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15699536 CPUtime=7.64 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 177776 0 1 0 740 24 0 0 22 0 22 0 519357989 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3924884 170579 2264 9 0 3915603 0
[pid=15233/tid=15234] ppid=15231 vsize=15699536 CPUtime=6.19 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) R 15231 15233 14691 0 -1 4202560 127221 0 1 0 603 16 0 0 25 0 22 0 519357989 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505729392 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=15233/tid=15236] ppid=15231 vsize=15699536 CPUtime=0.06 cores=0,2,4,6
/proc/15233/task/15236/stat : 15236 (java) S 15231 15233 14691 0 -1 4202560 5489 0 0 0 5 1 0 0 16 0 22 0 519357990 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15237] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15237/stat : 15237 (java) S 15231 15233 14691 0 -1 4202560 1574 0 0 0 0 0 0 0 16 0 22 0 519357990 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15238] ppid=15231 vsize=15699536 CPUtime=0.01 cores=0,2,4,6
/proc/15233/task/15238/stat : 15238 (java) S 15231 15233 14691 0 -1 4202560 14 0 0 0 1 0 0 0 15 0 22 0 519357990 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15239] ppid=15231 vsize=15699536 CPUtime=0.01 cores=0,2,4,6
/proc/15233/task/15239/stat : 15239 (java) S 15231 15233 14691 0 -1 4202560 1223 0 0 0 1 0 0 0 15 0 22 0 519357990 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15240] ppid=15231 vsize=15699536 CPUtime=0.01 cores=0,2,4,6
/proc/15233/task/15240/stat : 15240 (java) S 15231 15233 14691 0 -1 4202560 3461 0 0 0 1 0 0 0 15 0 22 0 519357990 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15241] ppid=15231 vsize=15699536 CPUtime=0.06 cores=0,2,4,6
/proc/15233/task/15241/stat : 15241 (java) S 15231 15233 14691 0 -1 4202560 13045 0 0 0 5 1 0 0 16 0 22 0 519357990 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15242] ppid=15231 vsize=15699536 CPUtime=0.05 cores=0,2,4,6
/proc/15233/task/15242/stat : 15242 (java) S 15231 15233 14691 0 -1 4202560 5129 0 0 0 5 0 0 0 16 0 22 0 519357990 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15243] ppid=15231 vsize=15699536 CPUtime=0.05 cores=0,2,4,6
/proc/15233/task/15243/stat : 15243 (java) S 15231 15233 14691 0 -1 4202560 5359 0 0 0 5 0 0 0 16 0 22 0 519357990 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15244] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15244/stat : 15244 (java) S 15231 15233 14691 0 -1 4202560 381 0 0 0 0 0 0 0 15 0 22 0 519357991 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 0 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15245] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15245/stat : 15245 (java) S 15231 15233 14691 0 -1 4202560 18 0 0 0 0 0 0 0 21 0 22 0 519357991 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15246] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15246/stat : 15246 (java) S 15231 15233 14691 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 519357991 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15247] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15247/stat : 15247 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519357993 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101521841 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15248] ppid=15231 vsize=15699536 CPUtime=0.57 cores=0,2,4,6
/proc/15233/task/15248/stat : 15248 (java) S 15231 15233 14691 0 -1 4202560 4479 0 0 0 57 0 0 0 15 0 22 0 519357993 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15249] ppid=15231 vsize=15699536 CPUtime=0.52 cores=0,2,4,6
/proc/15233/task/15249/stat : 15249 (java) S 15231 15233 14691 0 -1 4202560 8970 0 0 0 51 1 0 0 15 0 22 0 519357993 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15250] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15250/stat : 15250 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519357993 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15251] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15251/stat : 15251 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 519357993 16076324864 170579 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=15233/tid=15244] ppid=15231 vsize=15699536 CPUtime=24.96 cores=0,2,4,6
/proc/15233/task/15244/stat : 15244 (java) S 15231 15233 14691 0 -1 4202560 125359 0 0 0 2484 12 0 0 15 0 22 0 519357991 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 0 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15245] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15245/stat : 15245 (java) S 15231 15233 14691 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 519357991 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15246] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15246/stat : 15246 (java) S 15231 15233 14691 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 519357991 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15247] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15247/stat : 15247 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519357993 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101521841 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15248] ppid=15231 vsize=15699536 CPUtime=1.33 cores=0,2,4,6
/proc/15233/task/15248/stat : 15248 (java) S 15231 15233 14691 0 -1 4202560 5947 0 0 0 133 0 0 0 16 0 22 0 519357993 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15249] ppid=15231 vsize=15699536 CPUtime=1.26 cores=0,2,4,6
/proc/15233/task/15249/stat : 15249 (java) S 15231 15233 14691 0 -1 4202560 9044 0 0 0 125 1 0 0 15 0 22 0 519357993 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15250] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15250/stat : 15250 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519357993 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15251] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15251/stat : 15251 (java) S 15231 15233 14691 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 519357993 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15256] ppid=15231 vsize=15699536 CPUtime=1050.5 cores=0,2,4,6
/proc/15233/task/15256/stat : 15256 (java) R 15231 15233 14691 0 -1 4202560 11102 0 0 0 105049 1 0 0 25 0 22 0 519358348 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912506018434 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=15233/tid=15257] ppid=15231 vsize=15699536 CPUtime=938.71 cores=0,2,4,6
/proc/15233/task/15257/stat : 15257 (java) R 15231 15233 14691 0 -1 4202560 3552 0 0 0 93870 1 0 0 25 0 22 0 519358348 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505920614 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=15233/tid=15258] ppid=15231 vsize=15699536 CPUtime=996.42 cores=0,2,4,6
/proc/15233/task/15258/stat : 15258 (java) R 15231 15233 14691 0 -1 4202560 8835 0 0 0 99641 1 0 0 25 0 22 0 519358348 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912506456231 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=15233/tid=15259] ppid=15231 vsize=15699536 CPUtime=999.02 cores=0,2,4,6
/proc/15233/task/15259/stat : 15259 (java) R 15231 15233 14691 0 -1 4202560 28108 0 0 0 99899 3 0 0 25 0 22 0 519358348 16076324864 3672860 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912506018393 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4172.49
Current children cumulated vsize (KiB) 15699536

[startup+1242.3 s]
/proc/loadavg: 8.18 8.02 7.23 9/220 15304
/proc/meminfo: memFree=1412016/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15699536 CPUtime=4404.32 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 3812838 0 1 0 439819 613 0 0 22 0 22 0 519357989 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3924884 3702242 2296 9 0 3915603 0
[pid=15233/tid=15234] ppid=15231 vsize=15699536 CPUtime=81.02 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) S 15231 15233 14691 0 -1 4202560 145742 0 1 0 8084 18 0 0 25 0 22 0 519357989 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15236] ppid=15231 vsize=15699536 CPUtime=10.82 cores=0,2,4,6
/proc/15233/task/15236/stat : 15236 (java) S 15231 15233 14691 0 -1 4202560 408097 0 0 0 1017 65 0 0 16 0 22 0 519357990 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15237] ppid=15231 vsize=15699536 CPUtime=10.31 cores=0,2,4,6
/proc/15233/task/15237/stat : 15237 (java) S 15231 15233 14691 0 -1 4202560 375600 0 0 0 974 57 0 0 16 0 22 0 519357990 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15238] ppid=15231 vsize=15699536 CPUtime=9.37 cores=0,2,4,6
/proc/15233/task/15238/stat : 15238 (java) S 15231 15233 14691 0 -1 4202560 346201 0 0 0 878 59 0 0 16 0 22 0 519357990 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15239] ppid=15231 vsize=15699536 CPUtime=11.36 cores=0,2,4,6
/proc/15233/task/15239/stat : 15239 (java) S 15231 15233 14691 0 -1 4202560 656183 0 0 0 1028 108 0 0 16 0 22 0 519357990 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15240] ppid=15231 vsize=15699536 CPUtime=9.78 cores=0,2,4,6
/proc/15233/task/15240/stat : 15240 (java) S 15231 15233 14691 0 -1 4202560 449731 0 0 0 906 72 0 0 16 0 22 0 519357990 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15241] ppid=15231 vsize=15699536 CPUtime=10.46 cores=0,2,4,6
/proc/15233/task/15241/stat : 15241 (java) S 15231 15233 14691 0 -1 4202560 506060 0 0 0 963 83 0 0 16 0 22 0 519357990 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15242] ppid=15231 vsize=15699536 CPUtime=10.56 cores=0,2,4,6
/proc/15233/task/15242/stat : 15242 (java) S 15231 15233 14691 0 -1 4202560 388733 0 0 0 993 63 0 0 16 0 22 0 519357990 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15243] ppid=15231 vsize=15699536 CPUtime=9.41 cores=0,2,4,6
/proc/15233/task/15243/stat : 15243 (java) S 15231 15233 14691 0 -1 4202560 343027 0 0 0 882 59 0 0 16 0 22 0 519357990 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15244] ppid=15231 vsize=15699536 CPUtime=27.57 cores=0,2,4,6
/proc/15233/task/15244/stat : 15244 (java) S 15231 15233 14691 0 -1 4202560 125412 0 0 0 2745 12 0 0 15 0 22 0 519357991 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 0 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15245] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15245/stat : 15245 (java) S 15231 15233 14691 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 519357991 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15246] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15246/stat : 15246 (java) S 15231 15233 14691 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 519357991 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15247] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15247/stat : 15247 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519357993 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101521841 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15248] ppid=15231 vsize=15699536 CPUtime=1.33 cores=0,2,4,6
/proc/15233/task/15248/stat : 15248 (java) S 15231 15233 14691 0 -1 4202560 5947 0 0 0 133 0 0 0 16 0 22 0 519357993 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15249] ppid=15231 vsize=15699536 CPUtime=1.26 cores=0,2,4,6
/proc/15233/task/15249/stat : 15249 (java) S 15231 15233 14691 0 -1 4202560 9044 0 0 0 125 1 0 0 15 0 22 0 519357993 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15250] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15250/stat : 15250 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519357993 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15251] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15251/stat : 15251 (java) S 15231 15233 14691 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 519357993 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15256] ppid=15231 vsize=15699536 CPUtime=1106.84 cores=0,2,4,6
/proc/15233/task/15256/stat : 15256 (java) R 15231 15233 14691 0 -1 4202560 11102 0 0 0 110683 1 0 0 25 0 22 0 519358348 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912506018308 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=15233/tid=15257] ppid=15231 vsize=15699536 CPUtime=995.35 cores=0,2,4,6
/proc/15233/task/15257/stat : 15257 (java) R 15231 15233 14691 0 -1 4202560 3553 0 0 0 99534 1 0 0 25 0 22 0 519358348 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505610474 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=15233/tid=15258] ppid=15231 vsize=15699536 CPUtime=1053.05 cores=0,2,4,6
/proc/15233/task/15258/stat : 15258 (java) R 15231 15233 14691 0 -1 4202560 8836 0 0 0 105304 1 0 0 25 0 22 0 519358348 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505920632 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=15233/tid=15259] ppid=15231 vsize=15699536 CPUtime=1055.65 cores=0,2,4,6
/proc/15233/task/15259/stat : 15259 (java) R 15231 15233 14691 0 -1 4202560 28110 0 0 0 105562 3 0 0 25 0 22 0 519358348 16076324864 3702242 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505920614 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4404.32
Current children cumulated vsize (KiB) 15699536



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300.01 s]
/proc/loadavg: 8.23 8.06 7.29 6/201 15309
/proc/meminfo: memFree=9261176/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=15699536 CPUtime=4625.23 cores=0,2,4,6
/proc/15233/stat : 15233 (java) S 15231 15233 14691 0 -1 4202496 3906995 0 1 0 461898 625 0 0 22 0 22 0 519357989 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 3924884 3796390 2296 9 0 3915603 0
[pid=15233/tid=15234] ppid=15231 vsize=15699536 CPUtime=81.02 cores=0,2,4,6
/proc/15233/task/15234/stat : 15234 (java) S 15231 15233 14691 0 -1 4202560 145742 0 1 0 8084 18 0 0 25 0 22 0 519357989 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15236] ppid=15231 vsize=15699536 CPUtime=10.82 cores=0,2,4,6
/proc/15233/task/15236/stat : 15236 (java) S 15231 15233 14691 0 -1 4202560 408097 0 0 0 1017 65 0 0 16 0 22 0 519357990 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15237] ppid=15231 vsize=15699536 CPUtime=10.31 cores=0,2,4,6
/proc/15233/task/15237/stat : 15237 (java) S 15231 15233 14691 0 -1 4202560 375600 0 0 0 974 57 0 0 16 0 22 0 519357990 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15238] ppid=15231 vsize=15699536 CPUtime=9.37 cores=0,2,4,6
/proc/15233/task/15238/stat : 15238 (java) S 15231 15233 14691 0 -1 4202560 346201 0 0 0 878 59 0 0 16 0 22 0 519357990 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15239] ppid=15231 vsize=15699536 CPUtime=11.36 cores=0,2,4,6
/proc/15233/task/15239/stat : 15239 (java) S 15231 15233 14691 0 -1 4202560 656183 0 0 0 1028 108 0 0 16 0 22 0 519357990 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15240] ppid=15231 vsize=15699536 CPUtime=9.78 cores=0,2,4,6
/proc/15233/task/15240/stat : 15240 (java) S 15231 15233 14691 0 -1 4202560 449731 0 0 0 906 72 0 0 16 0 22 0 519357990 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15241] ppid=15231 vsize=15699536 CPUtime=10.46 cores=0,2,4,6
/proc/15233/task/15241/stat : 15241 (java) S 15231 15233 14691 0 -1 4202560 506060 0 0 0 963 83 0 0 16 0 22 0 519357990 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 2 0 0 0
[pid=15233/tid=15242] ppid=15231 vsize=15699536 CPUtime=10.56 cores=0,2,4,6
/proc/15233/task/15242/stat : 15242 (java) S 15231 15233 14691 0 -1 4202560 388733 0 0 0 993 63 0 0 16 0 22 0 519357990 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15243] ppid=15231 vsize=15699536 CPUtime=9.41 cores=0,2,4,6
/proc/15233/task/15243/stat : 15243 (java) S 15231 15233 14691 0 -1 4202560 343027 0 0 0 882 59 0 0 16 0 22 0 519357990 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 6 0 0 0
[pid=15233/tid=15244] ppid=15231 vsize=15699536 CPUtime=30.79 cores=0,2,4,6
/proc/15233/task/15244/stat : 15244 (java) S 15231 15233 14691 0 -1 4202560 219564 0 0 0 3055 24 0 0 15 0 22 0 519357991 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 0 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15245] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15245/stat : 15245 (java) S 15231 15233 14691 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 519357991 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15246] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15246/stat : 15246 (java) S 15231 15233 14691 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 519357991 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15247] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15247/stat : 15247 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519357993 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101521841 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15248] ppid=15231 vsize=15699536 CPUtime=1.33 cores=0,2,4,6
/proc/15233/task/15248/stat : 15248 (java) S 15231 15233 14691 0 -1 4202560 5947 0 0 0 133 0 0 0 16 0 22 0 519357993 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 0 0 0 0
[pid=15233/tid=15249] ppid=15231 vsize=15699536 CPUtime=1.26 cores=0,2,4,6
/proc/15233/task/15249/stat : 15249 (java) S 15231 15233 14691 0 -1 4202560 9044 0 0 0 125 1 0 0 15 0 22 0 519357993 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15250] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15250/stat : 15250 (java) S 15231 15233 14691 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 519357993 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514137 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15251] ppid=15231 vsize=15699536 CPUtime=0 cores=0,2,4,6
/proc/15233/task/15251/stat : 15251 (java) S 15231 15233 14691 0 -1 4202560 76 0 0 0 0 0 0 0 15 0 22 0 519357993 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 248101514752 0 4 0 16800975 18446604453853080320 0 0 -1 4 0 0 0
[pid=15233/tid=15256] ppid=15231 vsize=15699536 CPUtime=1161.03 cores=0,2,4,6
/proc/15233/task/15256/stat : 15256 (java) R 15231 15233 14691 0 -1 4202560 11102 0 0 0 116102 1 0 0 25 0 22 0 519358348 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912506248774 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=15233/tid=15257] ppid=15231 vsize=15699536 CPUtime=1049.85 cores=0,2,4,6
/proc/15233/task/15257/stat : 15257 (java) R 15231 15233 14691 0 -1 4202560 3555 0 0 0 104984 1 0 0 25 0 22 0 519358348 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505366066 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=15233/tid=15258] ppid=15231 vsize=15699536 CPUtime=1107.56 cores=0,2,4,6
/proc/15233/task/15258/stat : 15258 (java) R 15231 15233 14691 0 -1 4202560 8836 0 0 0 110755 1 0 0 25 0 22 0 519358348 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505689600 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=15233/tid=15259] ppid=15231 vsize=15699536 CPUtime=1110.15 cores=0,2,4,6
/proc/15233/task/15259/stat : 15259 (java) R 15231 15233 14691 0 -1 4202560 28111 0 0 0 111012 3 0 0 25 0 22 0 519358348 16076324864 3796390 33554432000 1073741824 1073778376 140736668469536 18446744073709551615 46912505920632 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4625.23
Current children cumulated vsize (KiB) 15699536

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.2 s]
/proc/loadavg: 8.23 8.06 7.29 6/201 15309
/proc/meminfo: memFree=9261176/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=0 CPUtime=4625.45 cores=0,2,4,6
/proc/15233/stat : 15233 (java) Z 15231 15233 14691 0 -1 4203548 3907021 0 1 0 461902 643 0 0 17 0 2 0 519357989 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 0 0 0 0 0 0 0
[pid=15233/tid=15258] ppid=15231 vsize=0 CPUtime=1107.74 cores=0,2,4,6
/proc/15233/task/15258/stat : 15258 (java) R 15231 15233 14691 0 -1 4203588 8836 0 0 0 110755 19 0 0 25 0 2 0 519358348 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4625.45
Current children cumulated vsize (KiB) 0

[startup+1300.4 s]
/proc/loadavg: 8.23 8.06 7.29 6/201 15309
/proc/meminfo: memFree=9261176/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=0 CPUtime=4625.65 cores=0,2,4,6
/proc/15233/stat : 15233 (java) Z 15231 15233 14691 0 -1 4203548 3907021 0 1 0 461902 663 0 0 17 0 2 0 519357989 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 0 0 0 0 0 0 0
[pid=15233/tid=15258] ppid=15231 vsize=0 CPUtime=1107.94 cores=0,2,4,6
/proc/15233/task/15258/stat : 15258 (java) R 15231 15233 14691 0 -1 4203588 8836 0 0 0 110755 39 0 0 25 0 2 0 519358348 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4625.65
Current children cumulated vsize (KiB) 0

[startup+1300.5 s]
/proc/loadavg: 8.23 8.06 7.29 6/201 15309
/proc/meminfo: memFree=9261176/32950928 swapFree=67111428/67111528
[pid=15233] ppid=15231 vsize=0 CPUtime=4625.75 cores=0,2,4,6
/proc/15233/stat : 15233 (java) Z 15231 15233 14691 0 -1 4203548 3907021 0 1 0 461902 673 0 0 17 0 2 0 519357989 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/15233/statm: 0 0 0 0 0 0 0
[pid=15233/tid=15258] ppid=15231 vsize=0 CPUtime=1108.04 cores=0,2,4,6
/proc/15233/task/15258/stat : 15258 (java) R 15231 15233 14691 0 -1 4203588 8836 0 0 0 110755 49 0 0 25 0 2 0 519358348 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4625.75
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1300.58
CPU time (s): 4625.83
CPU user time (s): 4619.02
CPU system time (s): 6.80696
CPU usage (%): 355.675
Max. virtual memory (cumulated for all children) (KiB): 15702924

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4619.02
system time used= 6.80696
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3907021
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 45807
involuntary context switches= 76801

runsolver used 2.19167 second user time and 4.95025 second system time

The end

Launcher Data

Begin job on node123 at 2011-04-29 13:46:22
IDJOB=3312138
IDBENCH=71010
IDSOLVER=1698
FILE ID=node123/3312138-1304077581
RUNJOBID= node123-1304077581-15196
PBS_JOBID= 13170492
Free space on /tmp= 72788 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UCG-15-10p1.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312138-1304077581/watcher-3312138-1304077581 -o /tmp/evaluation-result-3312138-1304077581/solver-3312138-1304077581 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312138-1304077581.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 484dad50fb275faff8eff92c4d5447cb
RANDOM SEED=675415932

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30695260 kB
Buffers:        545652 kB
Cached:        1244144 kB
SwapCached:        100 kB
Active:         149688 kB
Inactive:      1743480 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30695260 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:           33904 kB
Writeback:           0 kB
AnonPages:      102336 kB
Mapped:          22640 kB
Slab:           298884 kB
PageTables:       5080 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   787624 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72796 MiB
End job on node123 at 2011-04-29 14:08:04