Trace number 3313438

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 3686.37 1302.53

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
grid-strips-grid-y-3.035-NOTKNOWN.cnf
MD5SUMa85b6db657886fb2a1a46ae1fe4d7999
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark206.556
Satisfiable
(Un)Satisfiability was proved
Number of variables257380
Number of clauses2139615
Sum of the clauses size5163755
Maximum clause length541
Minimum clause length1
Number of clauses of size 1625
Number of clauses of size 22096290
Number of clauses of size 30
Number of clauses of size 4280
Number of clauses of size 51400
Number of clauses of size over 541020

Solver Data 

0.10/0.12	00:07 INFO : Reading from input HOME/instance-3313438-1304103605.cnf
7.17/6.82	Executor set job limit to 1000000
7.17/6.83	Executor set job limit to 1000000
7.17/6.83	Executor set job limit to 1000000
7.17/6.83	Executor set job limit to 1000000
7.17/6.83	Starting Executor!
7.17/6.83	Starting Executor!
7.17/6.83	Starting Executor!
7.17/6.83	Starting Executor!
59.21/56.77	01:03 INFO : 187973 variables remaining out of 257380
59.21/56.77	01:03 INFO : 15782179 literals remaining out of 7303370
3348.66/965.02	16:12 ERROR: Failed to solve instance
3348.66/965.02	java.lang.OutOfMemoryError: Java heap space
3348.66/965.02		at gnu.trove.TIntArrayList.toNativeArray(TIntArrayList.java:532)
3348.66/965.02		at gnu.trove.TIntArrayList.toNativeArray(TIntArrayList.java:521)
3348.66/965.02		at gnu.trove.TIntArrayList.clone(TIntArrayList.java:486)
3348.66/965.02		at ibis.structure.WatchLists.<init>(WatchLists.java:32)
3348.66/965.02		at ibis.structure.Solver.<init>(Solver.java:37)
3348.66/965.02		at ibis.structure.SolveActivity.initialize(SolveActivity.java:28)
3348.66/965.02		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
3348.66/965.02		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
3348.66/965.02		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
3348.66/965.02		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
3348.66/965.02		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
3348.66/965.02		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
3348.66/965.02		at ibis.constellation.Executor.processActivities(Executor.java:75)
3348.66/965.02		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
3348.66/965.02		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
3348.66/965.02		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)
3350.88/967.20	16:14 ERROR: Failed to solve instance
3350.88/967.20	java.lang.OutOfMemoryError: Java heap space
3350.88/967.20		at gnu.trove.TIntArrayList.toNativeArray(TIntArrayList.java:532)
3350.88/967.20		at gnu.trove.TIntArrayList.toNativeArray(TIntArrayList.java:521)
3350.88/967.20		at gnu.trove.TIntArrayList.clone(TIntArrayList.java:486)
3350.88/967.20		at ibis.structure.WatchLists.<init>(WatchLists.java:32)
3350.88/967.20		at ibis.structure.Solver.<init>(Solver.java:37)
3350.88/967.20		at ibis.structure.SolveActivity.initialize(SolveActivity.java:28)
3350.88/967.20		at ibis.constellation.impl.ActivityRecord.runStateMachine(ActivityRecord.java:143)
3350.88/967.20		at ibis.constellation.impl.ActivityRecord.run(ActivityRecord.java:215)
3350.88/967.20		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:398)
3350.88/967.20		at ibis.constellation.impl.ExecutorWrapper.process(ExecutorWrapper.java:420)
3350.88/967.20		at ibis.constellation.impl.SingleThreadedConstellation.processActivities(SingleThreadedConstellation.java:1023)
3350.88/967.20		at ibis.constellation.impl.ExecutorWrapper.processActivities(ExecutorWrapper.java:515)
3350.88/967.20		at ibis.constellation.Executor.processActivities(Executor.java:75)
3350.88/967.20		at ibis.constellation.SimpleExecutor.run(SimpleExecutor.java:54)
3350.88/967.20		at ibis.constellation.impl.ExecutorWrapper.runExecutor(ExecutorWrapper.java:521)
3350.88/967.20		at ibis.constellation.impl.SingleThreadedConstellation.run(SingleThreadedConstellation.java:1070)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3313438-1304103605/watcher-3313438-1304103605 -o /tmp/evaluation-result-3313438-1304103605/solver-3313438-1304103605 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3313438-1304103605.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.90 3.03 4.19 1/172 22291
/proc/meminfo: memFree=30800360/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=23028 CPUtime=0 cores=1,3,5,7
/proc/22291/stat : 22291 (java) R 22289 22291 21560 0 -1 4202496 684 0 0 0 0 0 0 0 22 0 1 0 600591247 23580672 170 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260015473744 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/22291/statm: 5757 183 149 9 0 124 0

[startup+0.102673 s]
/proc/loadavg: 2.90 3.03 4.19 1/172 22291
/proc/meminfo: memFree=30800360/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15676836 CPUtime=0.1 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 5517 0 1 0 9 1 0 0 22 0 18 0 600591247 16053080064 4955 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3919209 4955 2116 9 0 3909928 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676836

[startup+0.204737 s]
/proc/loadavg: 2.90 3.03 4.19 1/172 22291
/proc/meminfo: memFree=30800360/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15677388 CPUtime=0.27 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 7486 0 1 0 25 2 0 0 22 0 18 0 600591247 16053645312 6787 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3919347 6788 2181 9 0 3910066 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 15677388

[startup+0.300637 s]
/proc/loadavg: 2.90 3.03 4.19 1/172 22291
/proc/meminfo: memFree=30800360/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15679684 CPUtime=0.5 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 14138 0 1 0 48 2 0 0 22 0 18 0 600591247 16055996416 12571 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3919921 12571 2206 9 0 3910640 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 15679684

[startup+0.700567 s]
/proc/loadavg: 2.90 3.03 4.19 1/172 22291
/proc/meminfo: memFree=30800360/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15679536 CPUtime=0.92 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 42340 0 1 0 86 6 0 0 22 0 18 0 600591247 16055844864 40733 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3919884 40733 2222 9 0 3910603 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 15679536

[startup+1.50145 s]
/proc/loadavg: 2.90 3.03 4.19 2/190 22309
/proc/meminfo: memFree=30632020/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15679536 CPUtime=1.74 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 76301 0 1 0 164 10 0 0 22 0 18 0 600591247 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3919884 74691 2222 9 0 3910603 0
[pid=22291/tid=22293] ppid=22289 vsize=15679536 CPUtime=1.46 cores=1,3,5,7
/proc/22291/task/22293/stat : 22293 (java) R 22289 22291 21560 0 -1 4202560 65773 0 1 0 137 9 0 0 19 0 18 0 600591247 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 46912505584096 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=22291/tid=22294] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22294/stat : 22294 (java) S 22289 22291 21560 0 -1 4202560 278 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22295] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22295/stat : 22295 (java) S 22289 22291 21560 0 -1 4202560 659 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22296] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22296/stat : 22296 (java) S 22289 22291 21560 0 -1 4202560 1317 0 0 0 0 0 0 0 16 0 18 0 600591248 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22297] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22297/stat : 22297 (java) S 22289 22291 21560 0 -1 4202560 354 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22298] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22298/stat : 22298 (java) S 22289 22291 21560 0 -1 4202560 90 0 0 0 0 0 0 0 16 0 18 0 600591248 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22299] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22299/stat : 22299 (java) S 22289 22291 21560 0 -1 4202560 1918 0 0 0 0 0 0 0 16 0 18 0 600591248 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22300] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22300/stat : 22300 (java) S 22289 22291 21560 0 -1 4202560 289 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22301] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22301/stat : 22301 (java) S 22289 22291 21560 0 -1 4202560 254 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22302] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22302/stat : 22302 (java) S 22289 22291 21560 0 -1 4202560 183 0 0 0 0 0 0 0 15 0 18 0 600591249 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 0 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22303] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22303/stat : 22303 (java) S 22289 22291 21560 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 18 0 600591250 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22304] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22304/stat : 22304 (java) S 22289 22291 21560 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 18 0 600591250 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22305] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22305/stat : 22305 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 600591252 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032219569 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22306] ppid=22289 vsize=15679536 CPUtime=0.09 cores=1,3,5,7
/proc/22291/task/22306/stat : 22306 (java) S 22289 22291 21560 0 -1 4202560 1019 0 0 0 9 0 0 0 19 0 18 0 600591252 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22307] ppid=22289 vsize=15679536 CPUtime=0.13 cores=1,3,5,7
/proc/22291/task/22307/stat : 22307 (java) S 22289 22291 21560 0 -1 4202560 2780 0 0 0 13 0 0 0 15 0 18 0 600591252 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22308] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22308/stat : 22308 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 600591252 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22309] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22309/stat : 22309 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 600591252 16055844864 74691 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.74
Current children cumulated vsize (KiB) 15679536

[startup+3.10117 s]
/proc/loadavg: 2.83 3.01 4.18 2/190 22309
/proc/meminfo: memFree=30315700/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15679536 CPUtime=3.42 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 146008 0 1 0 323 19 0 0 22 0 18 0 600591247 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3919884 144392 2240 9 0 3910603 0
[pid=22291/tid=22293] ppid=22289 vsize=15679536 CPUtime=3.03 cores=1,3,5,7
/proc/22291/task/22293/stat : 22293 (java) R 22289 22291 21560 0 -1 4202560 126846 0 1 0 287 16 0 0 24 0 18 0 600591247 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 46912505608434 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=22291/tid=22294] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22294/stat : 22294 (java) S 22289 22291 21560 0 -1 4202560 284 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22295] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22295/stat : 22295 (java) S 22289 22291 21560 0 -1 4202560 3241 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22296] ppid=22289 vsize=15679536 CPUtime=0.01 cores=1,3,5,7
/proc/22291/task/22296/stat : 22296 (java) S 22289 22291 21560 0 -1 4202560 1392 0 0 0 1 0 0 0 16 0 18 0 600591248 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22297] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22297/stat : 22297 (java) S 22289 22291 21560 0 -1 4202560 354 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22298] ppid=22289 vsize=15679536 CPUtime=0.01 cores=1,3,5,7
/proc/22291/task/22298/stat : 22298 (java) S 22289 22291 21560 0 -1 4202560 106 0 0 0 1 0 0 0 15 0 18 0 600591248 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22299] ppid=22289 vsize=15679536 CPUtime=0.01 cores=1,3,5,7
/proc/22291/task/22299/stat : 22299 (java) S 22289 22291 21560 0 -1 4202560 2423 0 0 0 1 0 0 0 15 0 18 0 600591248 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22300] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22300/stat : 22300 (java) S 22289 22291 21560 0 -1 4202560 5435 0 0 0 0 0 0 0 16 0 18 0 600591248 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22301] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22301/stat : 22301 (java) S 22289 22291 21560 0 -1 4202560 254 0 0 0 0 0 0 0 16 0 18 0 600591248 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22302] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22302/stat : 22302 (java) S 22289 22291 21560 0 -1 4202560 435 0 0 0 0 0 0 0 15 0 18 0 600591249 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 0 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22303] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22303/stat : 22303 (java) S 22289 22291 21560 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 18 0 600591250 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22304] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22304/stat : 22304 (java) S 22289 22291 21560 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 18 0 600591250 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22305] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22305/stat : 22305 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 600591252 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032219569 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22306] ppid=22289 vsize=15679536 CPUtime=0.11 cores=1,3,5,7
/proc/22291/task/22306/stat : 22306 (java) S 22289 22291 21560 0 -1 4202560 1031 0 0 0 11 0 0 0 15 0 18 0 600591252 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22307] ppid=22289 vsize=15679536 CPUtime=0.16 cores=1,3,5,7
/proc/22291/task/22307/stat : 22307 (java) S 22289 22291 21560 0 -1 4202560 2820 0 0 0 16 0 0 0 15 0 18 0 600591252 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22308] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22308/stat : 22308 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 600591252 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22309] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22309/stat : 22309 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 600591252 16055844864 144392 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.42
Current children cumulated vsize (KiB) 15679536

[startup+6.30158 s]
/proc/loadavg: 2.83 3.01 4.18 2/189 22309
/proc/meminfo: memFree=29675672/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15679536 CPUtime=6.68 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 284794 0 1 0 632 36 0 0 22 0 18 0 600591247 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3919884 282564 2240 9 0 3910603 0
[pid=22291/tid=22293] ppid=22289 vsize=15679536 CPUtime=6.21 cores=1,3,5,7
/proc/22291/task/22293/stat : 22293 (java) R 22289 22291 21560 0 -1 4202560 255119 0 1 0 590 31 0 0 21 0 18 0 600591247 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 46912505639251 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=22291/tid=22294] ppid=22289 vsize=15679536 CPUtime=0.02 cores=1,3,5,7
/proc/22291/task/22294/stat : 22294 (java) S 22289 22291 21560 0 -1 4202560 10525 0 0 0 1 1 0 0 16 0 18 0 600591248 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22295] ppid=22289 vsize=15679536 CPUtime=0.01 cores=1,3,5,7
/proc/22291/task/22295/stat : 22295 (java) S 22289 22291 21560 0 -1 4202560 3241 0 0 0 1 0 0 0 15 0 18 0 600591248 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22296] ppid=22289 vsize=15679536 CPUtime=0.02 cores=1,3,5,7
/proc/22291/task/22296/stat : 22296 (java) S 22289 22291 21560 0 -1 4202560 1392 0 0 0 2 0 0 0 15 0 18 0 600591248 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22297] ppid=22289 vsize=15679536 CPUtime=0.01 cores=1,3,5,7
/proc/22291/task/22297/stat : 22297 (java) S 22289 22291 21560 0 -1 4202560 354 0 0 0 1 0 0 0 15 0 18 0 600591248 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22298] ppid=22289 vsize=15679536 CPUtime=0.01 cores=1,3,5,7
/proc/22291/task/22298/stat : 22298 (java) S 22289 22291 21560 0 -1 4202560 107 0 0 0 1 0 0 0 15 0 18 0 600591248 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22299] ppid=22289 vsize=15679536 CPUtime=0.02 cores=1,3,5,7
/proc/22291/task/22299/stat : 22299 (java) S 22289 22291 21560 0 -1 4202560 2423 0 0 0 2 0 0 0 15 0 18 0 600591248 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22300] ppid=22289 vsize=15679536 CPUtime=0.02 cores=1,3,5,7
/proc/22291/task/22300/stat : 22300 (java) S 22289 22291 21560 0 -1 4202560 5435 0 0 0 2 0 0 0 15 0 18 0 600591248 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22301] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22301/stat : 22301 (java) S 22289 22291 21560 0 -1 4202560 255 0 0 0 0 0 0 0 15 0 18 0 600591248 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22302] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22302/stat : 22302 (java) S 22289 22291 21560 0 -1 4202560 705 0 0 0 0 0 0 0 15 0 18 0 600591249 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 0 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22303] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22303/stat : 22303 (java) S 22289 22291 21560 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 18 0 600591250 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22304] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22304/stat : 22304 (java) S 22289 22291 21560 0 -1 4202560 8 0 0 0 0 0 0 0 17 0 18 0 600591250 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22305] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22305/stat : 22305 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 600591252 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032219569 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22306] ppid=22289 vsize=15679536 CPUtime=0.11 cores=1,3,5,7
/proc/22291/task/22306/stat : 22306 (java) S 22289 22291 21560 0 -1 4202560 1031 0 0 0 11 0 0 0 15 0 18 0 600591252 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22307] ppid=22289 vsize=15679536 CPUtime=0.16 cores=1,3,5,7
/proc/22291/task/22307/stat : 22307 (java) S 22289 22291 21560 0 -1 4202560 2820 0 0 0 16 0 0 0 15 0 18 0 600591252 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22308] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22308/stat : 22308 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 600591252 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22309] ppid=22289 vsize=15679536 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22309/stat : 22309 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 600591252 16055844864 282564 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.68
Current children cumulated vsize (KiB) 15679536

[startup+12.7014 s]
/proc/loadavg: 2.55 2.94 4.15 2/193 22313
/proc/meminfo: memFree=29654120/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15704980 CPUtime=14.34 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 299567 0 1 0 1395 39 0 0 22 0 22 0 600591247 16081899520 287873 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3926245 287873 2276 9 0 3916964 0
[pid=22291/tid=22293] ppid=22289 vsize=15704980 CPUtime=12.61 cores=1,3,5,7

################
# More data... #
################

/proc/22291/task/22298/stat : 22298 (java) S 22289 22291 21560 0 -1 4202560 499005 0 0 0 871 86 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22299] ppid=22289 vsize=15770516 CPUtime=9.24 cores=1,3,5,7
/proc/22291/task/22299/stat : 22299 (java) S 22289 22291 21560 0 -1 4202560 405175 0 0 0 853 71 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22300] ppid=22289 vsize=15770516 CPUtime=9.06 cores=1,3,5,7
/proc/22291/task/22300/stat : 22300 (java) S 22289 22291 21560 0 -1 4202560 412823 0 0 0 836 70 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22301] ppid=22289 vsize=15770516 CPUtime=8.86 cores=1,3,5,7
/proc/22291/task/22301/stat : 22301 (java) S 22289 22291 21560 0 -1 4202560 488592 0 0 0 804 82 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22302] ppid=22289 vsize=15770516 CPUtime=309.15 cores=1,3,5,7
/proc/22291/task/22302/stat : 22302 (java) R 22289 22291 21560 0 -1 4202560 186093 0 0 0 30884 31 0 0 25 0 22 0 600591249 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 47455021471839 0 0 0 16800975 0 0 0 -1 1 0 0 0
[pid=22291/tid=22303] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22303/stat : 22303 (java) S 22289 22291 21560 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 600591250 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22304] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22304/stat : 22304 (java) S 22289 22291 21560 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 600591250 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22305] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22305/stat : 22305 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032219569 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22306] ppid=22289 vsize=15770516 CPUtime=1.81 cores=1,3,5,7
/proc/22291/task/22306/stat : 22306 (java) S 22289 22291 21560 0 -1 4202560 14630 0 0 0 180 1 0 0 16 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22307] ppid=22289 vsize=15770516 CPUtime=0.8 cores=1,3,5,7
/proc/22291/task/22307/stat : 22307 (java) S 22289 22291 21560 0 -1 4202560 5026 0 0 0 80 0 0 0 15 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22308] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22308/stat : 22308 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22309] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22309/stat : 22309 (java) S 22289 22291 21560 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22310] ppid=22289 vsize=15770516 CPUtime=767.16 cores=1,3,5,7
/proc/22291/task/22310/stat : 22310 (java) S 22289 22291 21560 0 -1 4202560 1748 0 0 0 76714 2 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22311] ppid=22289 vsize=15770516 CPUtime=765.31 cores=1,3,5,7
/proc/22291/task/22311/stat : 22311 (java) S 22289 22291 21560 0 -1 4202560 137 0 0 0 76531 0 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22312] ppid=22289 vsize=15770516 CPUtime=796.3 cores=1,3,5,7
/proc/22291/task/22312/stat : 22312 (java) S 22289 22291 21560 0 -1 4202560 182 0 0 0 79630 0 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22313] ppid=22289 vsize=15770516 CPUtime=796.26 cores=1,3,5,7
/proc/22291/task/22313/stat : 22313 (java) S 22289 22291 21560 0 -1 4202560 114 0 0 0 79626 0 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3566.12
Current children cumulated vsize (KiB) 15770516

[startup+1242.3 s]
/proc/loadavg: 1.02 2.02 3.14 2/193 22355
/proc/meminfo: memFree=15480260/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15770516 CPUtime=3626.13 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 3919645 0 1 0 361948 665 0 0 22 0 22 0 600591247 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3942629 3824952 2296 9 0 3933348 0
[pid=22291/tid=22293] ppid=22289 vsize=15770516 CPUtime=56.38 cores=1,3,5,7
/proc/22291/task/22293/stat : 22293 (java) S 22289 22291 21560 0 -1 4202560 255283 0 1 0 5606 32 0 0 25 0 22 0 600591247 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22294] ppid=22289 vsize=15770516 CPUtime=8.73 cores=1,3,5,7
/proc/22291/task/22294/stat : 22294 (java) S 22289 22291 21560 0 -1 4202560 487106 0 0 0 791 82 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22295] ppid=22289 vsize=15770516 CPUtime=8.33 cores=1,3,5,7
/proc/22291/task/22295/stat : 22295 (java) S 22289 22291 21560 0 -1 4202560 383697 0 0 0 770 63 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22296] ppid=22289 vsize=15770516 CPUtime=8.54 cores=1,3,5,7
/proc/22291/task/22296/stat : 22296 (java) S 22289 22291 21560 0 -1 4202560 358450 0 0 0 794 60 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22297] ppid=22289 vsize=15770516 CPUtime=10.43 cores=1,3,5,7
/proc/22291/task/22297/stat : 22297 (java) S 22289 22291 21560 0 -1 4202560 419612 0 0 0 971 72 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22298] ppid=22289 vsize=15770516 CPUtime=9.57 cores=1,3,5,7
/proc/22291/task/22298/stat : 22298 (java) S 22289 22291 21560 0 -1 4202560 499005 0 0 0 871 86 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22299] ppid=22289 vsize=15770516 CPUtime=9.24 cores=1,3,5,7
/proc/22291/task/22299/stat : 22299 (java) S 22289 22291 21560 0 -1 4202560 405175 0 0 0 853 71 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22300] ppid=22289 vsize=15770516 CPUtime=9.06 cores=1,3,5,7
/proc/22291/task/22300/stat : 22300 (java) S 22289 22291 21560 0 -1 4202560 412823 0 0 0 836 70 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22301] ppid=22289 vsize=15770516 CPUtime=8.86 cores=1,3,5,7
/proc/22291/task/22301/stat : 22301 (java) S 22289 22291 21560 0 -1 4202560 488592 0 0 0 804 82 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22302] ppid=22289 vsize=15770516 CPUtime=369.13 cores=1,3,5,7
/proc/22291/task/22302/stat : 22302 (java) R 22289 22291 21560 0 -1 4202560 186098 0 0 0 36881 32 0 0 25 0 22 0 600591249 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 47455016813104 0 0 0 16800975 0 0 0 -1 1 0 0 0
[pid=22291/tid=22303] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22303/stat : 22303 (java) S 22289 22291 21560 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 600591250 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22304] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22304/stat : 22304 (java) S 22289 22291 21560 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 600591250 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22305] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22305/stat : 22305 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032219569 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22306] ppid=22289 vsize=15770516 CPUtime=1.81 cores=1,3,5,7
/proc/22291/task/22306/stat : 22306 (java) S 22289 22291 21560 0 -1 4202560 14630 0 0 0 180 1 0 0 16 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22307] ppid=22289 vsize=15770516 CPUtime=0.8 cores=1,3,5,7
/proc/22291/task/22307/stat : 22307 (java) S 22289 22291 21560 0 -1 4202560 5026 0 0 0 80 0 0 0 15 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22308] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22308/stat : 22308 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22309] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22309/stat : 22309 (java) S 22289 22291 21560 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22310] ppid=22289 vsize=15770516 CPUtime=767.17 cores=1,3,5,7
/proc/22291/task/22310/stat : 22310 (java) S 22289 22291 21560 0 -1 4202560 2260 0 0 0 76715 2 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22311] ppid=22289 vsize=15770516 CPUtime=765.32 cores=1,3,5,7
/proc/22291/task/22311/stat : 22311 (java) S 22289 22291 21560 0 -1 4202560 137 0 0 0 76531 1 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22312] ppid=22289 vsize=15770516 CPUtime=796.3 cores=1,3,5,7
/proc/22291/task/22312/stat : 22312 (java) S 22289 22291 21560 0 -1 4202560 182 0 0 0 79630 0 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22313] ppid=22289 vsize=15770516 CPUtime=796.26 cores=1,3,5,7
/proc/22291/task/22313/stat : 22313 (java) S 22289 22291 21560 0 -1 4202560 114 0 0 0 79626 0 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3626.13
Current children cumulated vsize (KiB) 15770516



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 1.00 1.83 3.00 2/193 22356
/proc/meminfo: memFree=15480216/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=15770516 CPUtime=3683.83 cores=1,3,5,7
/proc/22291/stat : 22291 (java) S 22289 22291 21560 0 -1 4202496 3920145 0 1 0 367717 666 0 0 22 0 22 0 600591247 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 3942629 3824952 2296 9 0 3933348 0
[pid=22291/tid=22293] ppid=22289 vsize=15770516 CPUtime=56.38 cores=1,3,5,7
/proc/22291/task/22293/stat : 22293 (java) S 22289 22291 21560 0 -1 4202560 255283 0 1 0 5606 32 0 0 25 0 22 0 600591247 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22294] ppid=22289 vsize=15770516 CPUtime=8.73 cores=1,3,5,7
/proc/22291/task/22294/stat : 22294 (java) S 22289 22291 21560 0 -1 4202560 487106 0 0 0 791 82 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22295] ppid=22289 vsize=15770516 CPUtime=8.33 cores=1,3,5,7
/proc/22291/task/22295/stat : 22295 (java) S 22289 22291 21560 0 -1 4202560 383697 0 0 0 770 63 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22296] ppid=22289 vsize=15770516 CPUtime=8.54 cores=1,3,5,7
/proc/22291/task/22296/stat : 22296 (java) S 22289 22291 21560 0 -1 4202560 358450 0 0 0 794 60 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22297] ppid=22289 vsize=15770516 CPUtime=10.43 cores=1,3,5,7
/proc/22291/task/22297/stat : 22297 (java) S 22289 22291 21560 0 -1 4202560 419612 0 0 0 971 72 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22298] ppid=22289 vsize=15770516 CPUtime=9.57 cores=1,3,5,7
/proc/22291/task/22298/stat : 22298 (java) S 22289 22291 21560 0 -1 4202560 499005 0 0 0 871 86 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22299] ppid=22289 vsize=15770516 CPUtime=9.24 cores=1,3,5,7
/proc/22291/task/22299/stat : 22299 (java) S 22289 22291 21560 0 -1 4202560 405175 0 0 0 853 71 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22300] ppid=22289 vsize=15770516 CPUtime=9.06 cores=1,3,5,7
/proc/22291/task/22300/stat : 22300 (java) S 22289 22291 21560 0 -1 4202560 412823 0 0 0 836 70 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22301] ppid=22289 vsize=15770516 CPUtime=8.86 cores=1,3,5,7
/proc/22291/task/22301/stat : 22301 (java) S 22289 22291 21560 0 -1 4202560 488592 0 0 0 804 82 0 0 16 0 22 0 600591248 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22302] ppid=22289 vsize=15770516 CPUtime=426.83 cores=1,3,5,7
/proc/22291/task/22302/stat : 22302 (java) R 22289 22291 21560 0 -1 4202560 186102 0 0 0 42650 33 0 0 25 0 22 0 600591249 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 47455020743792 0 0 0 16800975 0 0 0 -1 1 0 0 0
[pid=22291/tid=22303] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22303/stat : 22303 (java) S 22289 22291 21560 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 22 0 600591250 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
[pid=22291/tid=22304] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22304/stat : 22304 (java) S 22289 22291 21560 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 600591250 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22305] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22305/stat : 22305 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032219569 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22306] ppid=22289 vsize=15770516 CPUtime=1.81 cores=1,3,5,7
/proc/22291/task/22306/stat : 22306 (java) S 22289 22291 21560 0 -1 4202560 14630 0 0 0 180 1 0 0 16 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 7 0 0 0
[pid=22291/tid=22307] ppid=22289 vsize=15770516 CPUtime=0.8 cores=1,3,5,7
/proc/22291/task/22307/stat : 22307 (java) S 22289 22291 21560 0 -1 4202560 5026 0 0 0 80 0 0 0 15 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22308] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22308/stat : 22308 (java) S 22289 22291 21560 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22309] ppid=22289 vsize=15770516 CPUtime=0 cores=1,3,5,7
/proc/22291/task/22309/stat : 22309 (java) S 22289 22291 21560 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 600591252 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032212480 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22310] ppid=22289 vsize=15770516 CPUtime=767.19 cores=1,3,5,7
/proc/22291/task/22310/stat : 22310 (java) S 22289 22291 21560 0 -1 4202560 2752 0 0 0 76716 3 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22311] ppid=22289 vsize=15770516 CPUtime=765.32 cores=1,3,5,7
/proc/22291/task/22311/stat : 22311 (java) S 22289 22291 21560 0 -1 4202560 137 0 0 0 76531 1 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 1 0 0 0
[pid=22291/tid=22312] ppid=22289 vsize=15770516 CPUtime=796.3 cores=1,3,5,7
/proc/22291/task/22312/stat : 22312 (java) S 22289 22291 21560 0 -1 4202560 182 0 0 0 79630 0 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 5 0 0 0
[pid=22291/tid=22313] ppid=22289 vsize=15770516 CPUtime=796.26 cores=1,3,5,7
/proc/22291/task/22313/stat : 22313 (java) S 22289 22291 21560 0 -1 4202560 114 0 0 0 79626 0 0 0 15 0 22 0 600591930 16149008384 3824952 33554432000 1073741824 1073778376 140735675898992 18446744073709551615 260032211865 0 4 0 16800975 18446604456433535040 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3683.83
Current children cumulated vsize (KiB) 15770516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -22291

[startup+1302.3 s]
/proc/loadavg: 1.00 1.82 2.99 2/194 22358
/proc/meminfo: memFree=15480196/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=0 CPUtime=3686.13 cores=1,3,5,7
/proc/22291/stat : 22291 (java) Z 22289 22291 21560 0 -1 4203548 3920168 0 1 0 367918 695 0 0 18 0 2 0 600591247 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 0 0 0 0 0 0 0
[pid=22291/tid=22302] ppid=22289 vsize=0 CPUtime=429.12 cores=1,3,5,7
/proc/22291/task/22302/stat : 22302 (java) R 22289 22291 21560 0 -1 4203588 186102 0 0 0 42851 61 0 0 25 0 2 0 600591249 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3686.13
Current children cumulated vsize (KiB) 0

Solver just ended. Dumping a history of the last processes samples

[startup+1302.5 s]
/proc/loadavg: 1.00 1.82 2.99 2/194 22358
/proc/meminfo: memFree=15480196/32951124 swapFree=67111464/67111528
[pid=22291] ppid=22289 vsize=0 CPUtime=3686.33 cores=1,3,5,7
/proc/22291/stat : 22291 (java) Z 22289 22291 21560 0 -1 4203548 3920168 0 1 0 367918 715 0 0 18 0 2 0 600591247 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/22291/statm: 0 0 0 0 0 0 0
[pid=22291/tid=22302] ppid=22289 vsize=0 CPUtime=429.32 cores=1,3,5,7
/proc/22291/task/22302/stat : 22302 (java) R 22289 22291 21560 0 -1 4203588 186102 0 0 0 42851 81 0 0 25 0 2 0 600591249 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3686.33
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1302.53
CPU time (s): 3686.37
CPU user time (s): 3679.19
CPU system time (s): 7.18491
CPU usage (%): 283.015
Max. virtual memory (cumulated for all children) (KiB): 15770516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3679.19
system time used= 7.18491
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3920168
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 47444
involuntary context switches= 63371

runsolver used 2.00869 second user time and 5.12222 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-29 21:00:07
IDJOB=3313438
IDBENCH=82403
IDSOLVER=1699
FILE ID=node110/3313438-1304103605
RUNJOBID= node110-1304102301-22142
PBS_JOBID= 13170606
Free space on /tmp= 72800 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/application/rintanen/SATPlanning/grid-strips-grid-y-3.035-NOTKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3313438-1304103605/watcher-3313438-1304103605 -o /tmp/evaluation-result-3313438-1304103605/solver-3313438-1304103605 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3313438-1304103605.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a85b6db657886fb2a1a46ae1fe4d7999
RANDOM SEED=746857643

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30800640 kB
Buffers:        911404 kB
Cached:         766472 kB
SwapCached:         64 kB
Active:         166924 kB
Inactive:      1575584 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30800640 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:           41868 kB
Writeback:           0 kB
AnonPages:       64216 kB
Mapped:          14540 kB
Slab:           343296 kB
PageTables:       4592 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187812 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72800 MiB
End job on node110 at 2011-04-29 21:21:49