Trace number 3313114

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.13 1207.34

General information on the benchmark

Namecrafted/skvortsov/
automata-synchronization/rnd_150_42_s.cnf
MD5SUM4177e06821060b0db9493e3e34514fae
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark8.28674
Satisfiable
(Un)Satisfiability was proved
Number of variables6384
Number of clauses23817
Sum of the clauses size59934
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 211517
Number of clauses of size 312300
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.11	03:29 INFO : Reading from input HOME/instance-3313114-1304183009.cnf
0.51/0.36	Executor set job limit to 1000000
0.51/0.36	Executor set job limit to 1000000
0.51/0.36	Executor set job limit to 1000000
0.51/0.36	Executor set job limit to 1000000
0.51/0.36	Starting Executor!
0.51/0.36	Starting Executor!
0.51/0.36	Starting Executor!
0.51/0.36	Starting Executor!
2.37/1.00	03:30 INFO : 5272 variables remaining out of 6384
2.37/1.00	03:30 INFO : 88268 literals remaining out of 83751

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3313114-1304183009/watcher-3313114-1304183009 -o /tmp/evaluation-result-3313114-1304183009/solver-3313114-1304183009 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3313114-1304183009.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.41 6.81 7.55 7/198 28282
/proc/meminfo: memFree=30131996/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=27172 CPUtime=0 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 1424 0 0 0 0 0 0 0 25 0 2 0 529900699 27824128 894 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 6793 894 684 9 0 381 0
[pid=28282/tid=28283] ppid=28280 vsize=28384 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) R 28280 28282 27376 0 -1 4202560 71 0 0 0 0 0 0 0 25 0 2 0 529900699 29065216 898 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248084774535 0 0 4096 0 0 0 0 -1 4 0 0 0

[startup+0.052843 s]
/proc/loadavg: 4.41 6.81 7.55 7/198 28282
/proc/meminfo: memFree=30131996/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15675176 CPUtime=0.04 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 4139 0 1 0 4 0 0 0 25 0 18 0 529900699 16051380224 3578 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3918794 3578 1755 9 0 3909513 0
[pid=28282/tid=28283] ppid=28280 vsize=15675176 CPUtime=0.04 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) R 28280 28282 27376 0 -1 4202560 2721 0 1 0 4 0 0 0 25 0 18 0 529900699 16051380224 3578 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 47593308882963 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 15675176

[startup+0.100835 s]
/proc/loadavg: 4.41 6.81 7.55 7/198 28282
/proc/meminfo: memFree=30131996/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15676816 CPUtime=0.1 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 5559 0 1 0 9 1 0 0 25 0 18 0 529900699 16053059584 4998 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3919204 4998 2116 9 0 3909923 0
[pid=28282/tid=28283] ppid=28280 vsize=15676816 CPUtime=0.09 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) R 28280 28282 27376 0 -1 4202560 3454 0 1 0 8 1 0 0 25 0 18 0 529900699 16053059584 4998 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 47593306513315 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676816

[startup+0.300832 s]
/proc/loadavg: 4.41 6.81 7.55 7/198 28282
/proc/meminfo: memFree=30131996/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15680660 CPUtime=0.51 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 15795 0 1 0 50 1 0 0 25 0 18 0 529900699 16056995840 14274 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3920165 14279 2207 9 0 3910884 0
[pid=28282/tid=28283] ppid=28280 vsize=15680660 CPUtime=0.28 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) R 28280 28282 27376 0 -1 4202560 10775 0 1 0 27 1 0 0 18 0 18 0 529900699 16056995840 14282 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505641457 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15680660

[startup+0.700731 s]
/proc/loadavg: 4.41 6.81 7.55 7/198 28282
/proc/meminfo: memFree=30131996/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15711768 CPUtime=1.46 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 36752 0 1 0 141 5 0 0 25 0 22 0 529900699 16088850432 32460 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3927942 32461 2245 9 0 3918661 0
[pid=28282/tid=28283] ppid=28280 vsize=15711768 CPUtime=0.68 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) R 28280 28282 27376 0 -1 4202560 21244 0 1 0 65 3 0 0 20 0 22 0 529900699 16088850432 32461 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505602536 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 15711768

[startup+1.50159 s]
/proc/loadavg: 4.41 6.81 7.55 9/220 28304
/proc/meminfo: memFree=29874392/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15727264 CPUtime=3.91 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 68933 0 1 0 381 10 0 0 25 0 22 0 529900699 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3931816 56070 2273 9 0 3922535 0
[pid=28282/tid=28283] ppid=28280 vsize=15727264 CPUtime=0.99 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) S 28280 28282 27376 0 -1 4202560 22448 0 1 0 96 3 0 0 21 0 22 0 529900699 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28285] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28285/stat : 28285 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 529900700 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28286] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28286/stat : 28286 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 529900700 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28287] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28287/stat : 28287 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 529900700 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28288] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28288/stat : 28288 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 529900700 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28289] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28289/stat : 28289 (java) S 28280 28282 27376 0 -1 4202560 638 0 0 0 0 0 0 0 18 0 22 0 529900700 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28290] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28290/stat : 28290 (java) S 28280 28282 27376 0 -1 4202560 135 0 0 0 0 0 0 0 18 0 22 0 529900700 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28291] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28291/stat : 28291 (java) S 28280 28282 27376 0 -1 4202560 621 0 0 0 0 0 0 0 18 0 22 0 529900700 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28292] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28292/stat : 28292 (java) S 28280 28282 27376 0 -1 4202560 1081 0 0 0 0 0 0 0 18 0 22 0 529900700 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28293] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28293/stat : 28293 (java) S 28280 28282 27376 0 -1 4202560 11 0 0 0 0 0 0 0 15 0 22 0 529900701 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 0 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28294] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28294/stat : 28294 (java) R 28280 28282 27376 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 529900701 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28282/tid=28295] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28295/stat : 28295 (java) S 28280 28282 27376 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 22 0 529900701 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28296] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28296/stat : 28296 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101521841 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28297] ppid=28280 vsize=15727264 CPUtime=1.12 cores=0,2,4,6
/proc/28282/task/28297/stat : 28297 (java) R 28280 28282 27376 0 -1 4202560 10397 0 0 0 111 1 0 0 25 0 22 0 529900703 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101517057 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28282/tid=28298] ppid=28280 vsize=15727264 CPUtime=1.22 cores=0,2,4,6
/proc/28282/task/28298/stat : 28298 (java) R 28280 28282 27376 0 -1 4202560 20302 0 0 0 119 3 0 0 25 0 22 0 529900703 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 47593307311490 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28282/tid=28299] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28299/stat : 28299 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28300] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28300/stat : 28300 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529900703 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28301] ppid=28280 vsize=15727264 CPUtime=0.07 cores=0,2,4,6
/proc/28282/task/28301/stat : 28301 (java) S 28280 28282 27376 0 -1 4202560 1907 0 0 0 7 0 0 0 15 0 22 0 529900735 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28302] ppid=28280 vsize=15727264 CPUtime=0.29 cores=0,2,4,6
/proc/28282/task/28302/stat : 28302 (java) R 28280 28282 27376 0 -1 4202560 8788 0 0 0 28 1 0 0 16 0 22 0 529900735 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505854034 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28282/tid=28303] ppid=28280 vsize=15727264 CPUtime=0.08 cores=0,2,4,6
/proc/28282/task/28303/stat : 28303 (java) R 28280 28282 27376 0 -1 4202560 1183 0 0 0 8 0 0 0 16 0 22 0 529900735 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912506127121 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=28282/tid=28304] ppid=28280 vsize=15727264 CPUtime=0.06 cores=0,2,4,6
/proc/28282/task/28304/stat : 28304 (java) S 28280 28282 27376 0 -1 4202560 33 0 0 0 6 0 0 0 15 0 22 0 529900735 16104718336 56070 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.91
Current children cumulated vsize (KiB) 15727264

[startup+3.10131 s]
/proc/loadavg: 4.86 6.87 7.56 11/220 28304
/proc/meminfo: memFree=29342680/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15727264 CPUtime=10.23 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 183298 0 1 0 997 26 0 0 25 0 22 0 529900699 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3931816 170350 2274 9 0 3922535 0
[pid=28282/tid=28283] ppid=28280 vsize=15727264 CPUtime=0.99 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) S 28280 28282 27376 0 -1 4202560 22448 0 1 0 96 3 0 0 21 0 22 0 529900699 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28285] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28285/stat : 28285 (java) S 28280 28282 27376 0 -1 4202560 1020 0 0 0 0 0 0 0 15 0 22 0 529900700 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28286] ppid=28280 vsize=15727264 CPUtime=0.01 cores=0,2,4,6
/proc/28282/task/28286/stat : 28286 (java) S 28280 28282 27376 0 -1 4202560 5446 0 0 0 1 0 0 0 16 0 22 0 529900700 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28287] ppid=28280 vsize=15727264 CPUtime=0.01 cores=0,2,4,6
/proc/28282/task/28287/stat : 28287 (java) S 28280 28282 27376 0 -1 4202560 5045 0 0 0 1 0 0 0 16 0 22 0 529900700 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28288] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28288/stat : 28288 (java) S 28280 28282 27376 0 -1 4202560 3208 0 0 0 0 0 0 0 16 0 22 0 529900700 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28289] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28289/stat : 28289 (java) S 28280 28282 27376 0 -1 4202560 638 0 0 0 0 0 0 0 15 0 22 0 529900700 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28290] ppid=28280 vsize=15727264 CPUtime=0.03 cores=0,2,4,6
/proc/28282/task/28290/stat : 28290 (java) S 28280 28282 27376 0 -1 4202560 8461 0 0 0 2 1 0 0 15 0 22 0 529900700 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28291] ppid=28280 vsize=15727264 CPUtime=0.02 cores=0,2,4,6
/proc/28282/task/28291/stat : 28291 (java) S 28280 28282 27376 0 -1 4202560 7949 0 0 0 1 1 0 0 15 0 22 0 529900700 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28292] ppid=28280 vsize=15727264 CPUtime=0.02 cores=0,2,4,6
/proc/28282/task/28292/stat : 28292 (java) S 28280 28282 27376 0 -1 4202560 8416 0 0 0 1 1 0 0 16 0 22 0 529900700 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28293] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28293/stat : 28293 (java) S 28280 28282 27376 0 -1 4202560 472 0 0 0 0 0 0 0 15 0 22 0 529900701 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 0 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28294] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28294/stat : 28294 (java) S 28280 28282 27376 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 529900701 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28295] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28295/stat : 28295 (java) S 28280 28282 27376 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529900701 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28296] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28296/stat : 28296 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101521841 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28297] ppid=28280 vsize=15727264 CPUtime=1.18 cores=0,2,4,6
/proc/28282/task/28297/stat : 28297 (java) R 28280 28282 27376 0 -1 4202560 10407 0 0 0 117 1 0 0 22 0 22 0 529900703 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101524149 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28282/tid=28298] ppid=28280 vsize=15727264 CPUtime=1.53 cores=0,2,4,6
/proc/28282/task/28298/stat : 28298 (java) R 28280 28282 27376 0 -1 4202560 20371 0 0 0 150 3 0 0 23 0 22 0 529900703 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 47593305887020 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28282/tid=28299] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28299/stat : 28299 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28300] ppid=28280 vsize=15727264 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28300/stat : 28300 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 529900703 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28301] ppid=28280 vsize=15727264 CPUtime=1.52 cores=0,2,4,6
/proc/28282/task/28301/stat : 28301 (java) R 28280 28282 27376 0 -1 4202560 21673 0 0 0 151 1 0 0 17 0 22 0 529900735 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505819779 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=28282/tid=28302] ppid=28280 vsize=15727264 CPUtime=1.76 cores=0,2,4,6
/proc/28282/task/28302/stat : 28302 (java) R 28280 28282 27376 0 -1 4202560 27604 0 0 0 173 3 0 0 17 0 22 0 529900735 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505828216 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28282/tid=28303] ppid=28280 vsize=15727264 CPUtime=1.58 cores=0,2,4,6
/proc/28282/task/28303/stat : 28303 (java) R 28280 28282 27376 0 -1 4202560 20590 0 0 0 155 3 0 0 17 0 22 0 529900735 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505602396 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28282/tid=28304] ppid=28280 vsize=15727264 CPUtime=1.44 cores=0,2,4,6
/proc/28282/task/28304/stat : 28304 (java) R 28280 28282 27376 0 -1 4202560 18163 0 0 0 142 2 0 0 17 0 22 0 529900735 16104718336 170350 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505846237 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.23
Current children cumulated vsize (KiB) 15727264

[startup+6.30074 s]
/proc/loadavg: 4.86 6.87 7.56 9/220 28304
/proc/meminfo: memFree=27370644/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15718500 CPUtime=22.99 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 346765 0 1 0 2254 45 0 0 25 0 22 0 529900699 16095744000 330443 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3929625 330451 2287 9 0 3920344 0
[pid=28282/tid=28283] ppid=28280 vsize=15718500 CPUtime=0.99 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) S 28280 28282 27376 0 -1 4202560 22448 0 1 0 96 3 0 0 21 0 22 0 529900699 16095744000 330455 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28285] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28285/stat : 28285 (java) S 28280 28282 27376 0 -1 4202560 1757 0 0 0 0 0 0 0 15 0 22 0 529900700 16095744000 330458 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28286] ppid=28280 vsize=15718500 CPUtime=0.01 cores=0,2,4,6
/proc/28282/task/28286/stat : 28286 (java) S 28280 28282 27376 0 -1 4202560 5446 0 0 0 1 0 0 0 15 0 22 0 529900700 16095744000 330460 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28287] ppid=28280 vsize=15718500 CPUtime=0.01 cores=0,2,4,6
/proc/28282/task/28287/stat : 28287 (java) S 28280 28282 27376 0 -1 4202560 6431 0 0 0 1 0 0 0 16 0 22 0 529900700 16095744000 330464 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28288] ppid=28280 vsize=15718500 CPUtime=0.01 cores=0,2,4,6
/proc/28282/task/28288/stat : 28288 (java) S 28280 28282 27376 0 -1 4202560 4433 0 0 0 0 1 0 0 15 0 22 0 529900700 16095744000 330467 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28289] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28289/stat : 28289 (java) S 28280 28282 27376 0 -1 4202560 1780 0 0 0 0 0 0 0 16 0 22 0 529900700 16095744000 330474 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28290] ppid=28280 vsize=15718500 CPUtime=0.03 cores=0,2,4,6
/proc/28282/task/28290/stat : 28290 (java) S 28280 28282 27376 0 -1 4202560 9305 0 0 0 2 1 0 0 16 0 22 0 529900700 16095744000 330481 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28291] ppid=28280 vsize=15718500 CPUtime=0.02 cores=0,2,4,6
/proc/28282/task/28291/stat : 28291 (java) S 28280 28282 27376 0 -1 4202560 8324 0 0 0 1 1 0 0 16 0 22 0 529900700 16095744000 330496 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28292] ppid=28280 vsize=15718500 CPUtime=0.03 cores=0,2,4,6
/proc/28282/task/28292/stat : 28292 (java) S 28280 28282 27376 0 -1 4202560 10524 0 0 0 2 1 0 0 15 0 22 0 529900700 16095744000 330503 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=28282/tid=28302] ppid=28280 vsize=15718500 CPUtime=1106.65 cores=0,2,4,6
/proc/28282/task/28302/stat : 28302 (java) R 28280 28282 27376 0 -1 4202560 237377 0 0 0 110630 35 0 0 25 0 22 0 529900735 16095744000 156615 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505827629 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=28282/tid=28303] ppid=28280 vsize=15718500 CPUtime=1107.51 cores=0,2,4,6
/proc/28282/task/28303/stat : 28303 (java) R 28280 28282 27376 0 -1 4202560 260098 0 0 0 110714 37 0 0 25 0 22 0 529900735 16095744000 156615 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505828267 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28282/tid=28304] ppid=28280 vsize=15718500 CPUtime=1106.69 cores=0,2,4,6
/proc/28282/task/28304/stat : 28304 (java) R 28280 28282 27376 0 -1 4202560 252427 0 0 0 110631 38 0 0 25 0 22 0 529900735 16095744000 156615 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 47593310300211 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4462.06
Current children cumulated vsize (KiB) 15718500

[startup+1182.3 s]
/proc/loadavg: 4.07 4.49 5.90 5/193 28356
/proc/meminfo: memFree=29544756/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15718500 CPUtime=4700.64 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 1927613 0 1 0 469667 397 0 0 25 0 22 0 529900699 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3929625 180062 2298 9 0 3920344 0
[pid=28282/tid=28283] ppid=28280 vsize=15718500 CPUtime=0.99 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) S 28280 28282 27376 0 -1 4202560 22448 0 1 0 96 3 0 0 21 0 22 0 529900699 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28285] ppid=28280 vsize=15718500 CPUtime=3.54 cores=0,2,4,6
/proc/28282/task/28285/stat : 28285 (java) S 28280 28282 27376 0 -1 4202560 95191 0 0 0 335 19 0 0 16 0 22 0 529900700 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28286] ppid=28280 vsize=15718500 CPUtime=3.45 cores=0,2,4,6
/proc/28282/task/28286/stat : 28286 (java) S 28280 28282 27376 0 -1 4202560 92191 0 0 0 327 18 0 0 16 0 22 0 529900700 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28287] ppid=28280 vsize=15718500 CPUtime=3.5 cores=0,2,4,6
/proc/28282/task/28287/stat : 28287 (java) S 28280 28282 27376 0 -1 4202560 97888 0 0 0 331 19 0 0 16 0 22 0 529900700 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28288] ppid=28280 vsize=15718500 CPUtime=3.62 cores=0,2,4,6
/proc/28282/task/28288/stat : 28288 (java) S 28280 28282 27376 0 -1 4202560 98114 0 0 0 340 22 0 0 15 0 22 0 529900700 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28289] ppid=28280 vsize=15718500 CPUtime=3.49 cores=0,2,4,6
/proc/28282/task/28289/stat : 28289 (java) S 28280 28282 27376 0 -1 4202560 96031 0 0 0 331 18 0 0 15 0 22 0 529900700 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28290] ppid=28280 vsize=15718500 CPUtime=3.46 cores=0,2,4,6
/proc/28282/task/28290/stat : 28290 (java) S 28280 28282 27376 0 -1 4202560 96194 0 0 0 326 20 0 0 16 0 22 0 529900700 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28291] ppid=28280 vsize=15718500 CPUtime=3.61 cores=0,2,4,6
/proc/28282/task/28291/stat : 28291 (java) S 28280 28282 27376 0 -1 4202560 104770 0 0 0 338 23 0 0 15 0 22 0 529900700 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28292] ppid=28280 vsize=15718500 CPUtime=3.54 cores=0,2,4,6
/proc/28282/task/28292/stat : 28292 (java) S 28280 28282 27376 0 -1 4202560 101219 0 0 0 337 17 0 0 15 0 22 0 529900700 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28293] ppid=28280 vsize=15718500 CPUtime=2.08 cores=0,2,4,6
/proc/28282/task/28293/stat : 28293 (java) S 28280 28282 27376 0 -1 4202560 4840 0 0 0 139 69 0 0 15 0 22 0 529900701 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 0 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28294] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28294/stat : 28294 (java) S 28280 28282 27376 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 529900701 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28295] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28295/stat : 28295 (java) S 28280 28282 27376 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529900701 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28296] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28296/stat : 28296 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101521841 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28297] ppid=28280 vsize=15718500 CPUtime=1.75 cores=0,2,4,6
/proc/28282/task/28297/stat : 28297 (java) S 28280 28282 27376 0 -1 4202560 11695 0 0 0 174 1 0 0 15 0 22 0 529900703 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28298] ppid=28280 vsize=15718500 CPUtime=1.97 cores=0,2,4,6
/proc/28282/task/28298/stat : 28298 (java) S 28280 28282 27376 0 -1 4202560 20727 0 0 0 194 3 0 0 15 0 22 0 529900703 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28299] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28299/stat : 28299 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28300] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28300/stat : 28300 (java) S 28280 28282 27376 0 -1 4202560 59 0 0 0 0 0 0 0 15 0 22 0 529900703 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28301] ppid=28280 vsize=15718500 CPUtime=1166.81 cores=0,2,4,6
/proc/28282/task/28301/stat : 28301 (java) R 28280 28282 27376 0 -1 4202560 281108 0 0 0 116641 40 0 0 25 0 22 0 529900735 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505955933 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28282/tid=28302] ppid=28280 vsize=15718500 CPUtime=1165.9 cores=0,2,4,6
/proc/28282/task/28302/stat : 28302 (java) R 28280 28282 27376 0 -1 4202560 254068 0 0 0 116553 37 0 0 25 0 22 0 529900735 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505602150 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28282/tid=28303] ppid=28280 vsize=15718500 CPUtime=1166.79 cores=0,2,4,6
/proc/28282/task/28303/stat : 28303 (java) R 28280 28282 27376 0 -1 4202560 279025 0 0 0 116639 40 0 0 25 0 22 0 529900735 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 47593310302783 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28282/tid=28304] ppid=28280 vsize=15718500 CPUtime=1165.97 cores=0,2,4,6
/proc/28282/task/28304/stat : 28304 (java) R 28280 28282 27376 0 -1 4202560 270659 0 0 0 116557 40 0 0 25 0 22 0 529900735 16095744000 180062 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505956003 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4700.64
Current children cumulated vsize (KiB) 15718500



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.3 s]
/proc/loadavg: 4.04 4.45 5.85 5/193 28357
/proc/meminfo: memFree=29657076/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15718500 CPUtime=4800.06 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 1934719 0 1 0 479606 400 0 0 25 0 22 0 529900699 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3929625 152827 2298 9 0 3920344 0
[pid=28282/tid=28283] ppid=28280 vsize=15718500 CPUtime=0.99 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) S 28280 28282 27376 0 -1 4202560 22448 0 1 0 96 3 0 0 21 0 22 0 529900699 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28285] ppid=28280 vsize=15718500 CPUtime=3.61 cores=0,2,4,6
/proc/28282/task/28285/stat : 28285 (java) S 28280 28282 27376 0 -1 4202560 95451 0 0 0 342 19 0 0 16 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28286] ppid=28280 vsize=15718500 CPUtime=3.52 cores=0,2,4,6
/proc/28282/task/28286/stat : 28286 (java) S 28280 28282 27376 0 -1 4202560 92415 0 0 0 334 18 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28287] ppid=28280 vsize=15718500 CPUtime=3.56 cores=0,2,4,6
/proc/28282/task/28287/stat : 28287 (java) S 28280 28282 27376 0 -1 4202560 98432 0 0 0 337 19 0 0 16 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28288] ppid=28280 vsize=15718500 CPUtime=3.69 cores=0,2,4,6
/proc/28282/task/28288/stat : 28288 (java) S 28280 28282 27376 0 -1 4202560 98347 0 0 0 347 22 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28289] ppid=28280 vsize=15718500 CPUtime=3.57 cores=0,2,4,6
/proc/28282/task/28289/stat : 28289 (java) S 28280 28282 27376 0 -1 4202560 96628 0 0 0 339 18 0 0 16 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28290] ppid=28280 vsize=15718500 CPUtime=3.54 cores=0,2,4,6
/proc/28282/task/28290/stat : 28290 (java) S 28280 28282 27376 0 -1 4202560 96607 0 0 0 334 20 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28291] ppid=28280 vsize=15718500 CPUtime=3.66 cores=0,2,4,6
/proc/28282/task/28291/stat : 28291 (java) S 28280 28282 27376 0 -1 4202560 105472 0 0 0 343 23 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28292] ppid=28280 vsize=15718500 CPUtime=3.62 cores=0,2,4,6
/proc/28282/task/28292/stat : 28292 (java) S 28280 28282 27376 0 -1 4202560 101911 0 0 0 345 17 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28293] ppid=28280 vsize=15718500 CPUtime=2.14 cores=0,2,4,6
/proc/28282/task/28293/stat : 28293 (java) S 28280 28282 27376 0 -1 4202560 4912 0 0 0 143 71 0 0 15 0 22 0 529900701 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 0 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28294] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28294/stat : 28294 (java) S 28280 28282 27376 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 529900701 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28295] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28295/stat : 28295 (java) S 28280 28282 27376 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529900701 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28296] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28296/stat : 28296 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101521841 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28297] ppid=28280 vsize=15718500 CPUtime=1.75 cores=0,2,4,6
/proc/28282/task/28297/stat : 28297 (java) S 28280 28282 27376 0 -1 4202560 11695 0 0 0 174 1 0 0 15 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28298] ppid=28280 vsize=15718500 CPUtime=1.97 cores=0,2,4,6
/proc/28282/task/28298/stat : 28298 (java) S 28280 28282 27376 0 -1 4202560 20727 0 0 0 194 3 0 0 15 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28299] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28299/stat : 28299 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28300] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28300/stat : 28300 (java) S 28280 28282 27376 0 -1 4202560 61 0 0 0 0 0 0 0 15 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28301] ppid=28280 vsize=15718500 CPUtime=1191.56 cores=0,2,4,6
/proc/28282/task/28301/stat : 28301 (java) R 28280 28282 27376 0 -1 4202560 282217 0 0 0 119115 41 0 0 25 0 22 0 529900735 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505841997 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28282/tid=28302] ppid=28280 vsize=15718500 CPUtime=1190.58 cores=0,2,4,6
/proc/28282/task/28302/stat : 28302 (java) R 28280 28282 27376 0 -1 4202560 254764 0 0 0 119020 38 0 0 25 0 22 0 529900735 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912506163522 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28282/tid=28303] ppid=28280 vsize=15718500 CPUtime=1191.45 cores=0,2,4,6
/proc/28282/task/28303/stat : 28303 (java) R 28280 28282 27376 0 -1 4202560 279655 0 0 0 119105 40 0 0 25 0 22 0 529900735 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505827624 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28282/tid=28304] ppid=28280 vsize=15718500 CPUtime=1190.7 cores=0,2,4,6
/proc/28282/task/28304/stat : 28304 (java) R 28280 28282 27376 0 -1 4202560 271591 0 0 0 119030 40 0 0 25 0 22 0 529900735 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505583884 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 15718500

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.3 s]
/proc/loadavg: 4.04 4.45 5.85 5/193 28357
/proc/meminfo: memFree=29657076/32950928 swapFree=67111428/67111528
[pid=28282] ppid=28280 vsize=15718500 CPUtime=4800.06 cores=0,2,4,6
/proc/28282/stat : 28282 (java) S 28280 28282 27376 0 -1 4202496 1934719 0 1 0 479606 400 0 0 25 0 22 0 529900699 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/28282/statm: 3929625 152827 2298 9 0 3920344 0
[pid=28282/tid=28283] ppid=28280 vsize=15718500 CPUtime=0.99 cores=0,2,4,6
/proc/28282/task/28283/stat : 28283 (java) S 28280 28282 27376 0 -1 4202560 22448 0 1 0 96 3 0 0 21 0 22 0 529900699 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28285] ppid=28280 vsize=15718500 CPUtime=3.61 cores=0,2,4,6
/proc/28282/task/28285/stat : 28285 (java) S 28280 28282 27376 0 -1 4202560 95451 0 0 0 342 19 0 0 16 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28286] ppid=28280 vsize=15718500 CPUtime=3.52 cores=0,2,4,6
/proc/28282/task/28286/stat : 28286 (java) S 28280 28282 27376 0 -1 4202560 92415 0 0 0 334 18 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28287] ppid=28280 vsize=15718500 CPUtime=3.56 cores=0,2,4,6
/proc/28282/task/28287/stat : 28287 (java) S 28280 28282 27376 0 -1 4202560 98432 0 0 0 337 19 0 0 16 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28288] ppid=28280 vsize=15718500 CPUtime=3.69 cores=0,2,4,6
/proc/28282/task/28288/stat : 28288 (java) S 28280 28282 27376 0 -1 4202560 98347 0 0 0 347 22 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 6 0 0 0
[pid=28282/tid=28289] ppid=28280 vsize=15718500 CPUtime=3.57 cores=0,2,4,6
/proc/28282/task/28289/stat : 28289 (java) S 28280 28282 27376 0 -1 4202560 96628 0 0 0 339 18 0 0 16 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28290] ppid=28280 vsize=15718500 CPUtime=3.54 cores=0,2,4,6
/proc/28282/task/28290/stat : 28290 (java) S 28280 28282 27376 0 -1 4202560 96607 0 0 0 334 20 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28291] ppid=28280 vsize=15718500 CPUtime=3.66 cores=0,2,4,6
/proc/28282/task/28291/stat : 28291 (java) S 28280 28282 27376 0 -1 4202560 105472 0 0 0 343 23 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28292] ppid=28280 vsize=15718500 CPUtime=3.62 cores=0,2,4,6
/proc/28282/task/28292/stat : 28292 (java) S 28280 28282 27376 0 -1 4202560 101911 0 0 0 345 17 0 0 15 0 22 0 529900700 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28293] ppid=28280 vsize=15718500 CPUtime=2.14 cores=0,2,4,6
/proc/28282/task/28293/stat : 28293 (java) S 28280 28282 27376 0 -1 4202560 4912 0 0 0 143 71 0 0 15 0 22 0 529900701 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 0 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28294] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28294/stat : 28294 (java) S 28280 28282 27376 0 -1 4202560 18 0 0 0 0 0 0 0 18 0 22 0 529900701 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28295] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28295/stat : 28295 (java) S 28280 28282 27376 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 529900701 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28296] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28296/stat : 28296 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101521841 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28297] ppid=28280 vsize=15718500 CPUtime=1.75 cores=0,2,4,6
/proc/28282/task/28297/stat : 28297 (java) S 28280 28282 27376 0 -1 4202560 11695 0 0 0 174 1 0 0 15 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 2 0 0 0
[pid=28282/tid=28298] ppid=28280 vsize=15718500 CPUtime=1.97 cores=0,2,4,6
/proc/28282/task/28298/stat : 28298 (java) S 28280 28282 27376 0 -1 4202560 20727 0 0 0 194 3 0 0 15 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 0 0 0 0
[pid=28282/tid=28299] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28299/stat : 28299 (java) S 28280 28282 27376 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514137 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28300] ppid=28280 vsize=15718500 CPUtime=0 cores=0,2,4,6
/proc/28282/task/28300/stat : 28300 (java) S 28280 28282 27376 0 -1 4202560 61 0 0 0 0 0 0 0 15 0 22 0 529900703 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 248101514752 0 4 0 16800975 18446604452953377664 0 0 -1 4 0 0 0
[pid=28282/tid=28301] ppid=28280 vsize=15718500 CPUtime=1191.56 cores=0,2,4,6
/proc/28282/task/28301/stat : 28301 (java) R 28280 28282 27376 0 -1 4202560 282217 0 0 0 119115 41 0 0 25 0 22 0 529900735 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505841997 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28282/tid=28302] ppid=28280 vsize=15718500 CPUtime=1190.58 cores=0,2,4,6
/proc/28282/task/28302/stat : 28302 (java) R 28280 28282 27376 0 -1 4202560 254764 0 0 0 119020 38 0 0 25 0 22 0 529900735 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912506163522 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28282/tid=28303] ppid=28280 vsize=15718500 CPUtime=1191.45 cores=0,2,4,6
/proc/28282/task/28303/stat : 28303 (java) R 28280 28282 27376 0 -1 4202560 279655 0 0 0 119105 40 0 0 25 0 22 0 529900735 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505827624 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28282/tid=28304] ppid=28280 vsize=15718500 CPUtime=1190.7 cores=0,2,4,6
/proc/28282/task/28304/stat : 28304 (java) R 28280 28282 27376 0 -1 4202560 271591 0 0 0 119030 40 0 0 25 0 22 0 529900735 16095744000 152827 33554432000 1073741824 1073778376 140733533027136 18446744073709551615 46912505583884 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 15718500

Child status: 143
Real time (s): 1207.34
CPU time (s): 4800.13
CPU user time (s): 4796.1
CPU system time (s): 4.03339
CPU usage (%): 397.577
Max. virtual memory (cumulated for all children) (KiB): 15727264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.1
system time used= 4.03339
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1934746
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 229807
involuntary context switches= 128080

runsolver used 2.14167 second user time and 4.48932 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-30 19:03:29
IDJOB=3313114
IDBENCH=83188
IDSOLVER=1699
FILE ID=node123/3313114-1304183009
RUNJOBID= node123-1304183007-28143
PBS_JOBID= 13172429
Free space on /tmp= 73464 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/rnd_150_42_s.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3313114-1304183009/watcher-3313114-1304183009 -o /tmp/evaluation-result-3313114-1304183009/solver-3313114-1304183009 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3313114-1304183009.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4177e06821060b0db9493e3e34514fae
RANDOM SEED=1162129212

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30132648 kB
Buffers:        654840 kB
Cached:        1595600 kB
SwapCached:        100 kB
Active:         391252 kB
Inactive:      2055880 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30132648 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:            3980 kB
Writeback:           0 kB
AnonPages:      196320 kB
Mapped:          22992 kB
Slab:           308220 kB
PageTables:       4912 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   835312 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73464 MiB
End job on node123 at 2011-04-30 19:23:38