Trace number 3311267

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.23 1207.13

General information on the benchmark

Namerandom/large/
unif-k7-r85-v150-c12750-S1101422472-003-UNKNOWN.cnf
MD5SUM1a4e1674582e40801444509cae2068da
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark27.5668
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses12750
Sum of the clauses size89250
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 512750

Solver Data 

0.11/0.12	45:05 INFO : Reading from input HOME/instance-3311267-1304117105.cnf
0.53/0.38	Executor set job limit to 1000000
0.53/0.38	Executor set job limit to 1000000
0.53/0.38	Executor set job limit to 1000000
0.53/0.38	Executor set job limit to 1000000
0.53/0.38	Starting Executor!
0.53/0.38	Starting Executor!
0.53/0.38	Starting Executor!
0.53/0.38	Starting Executor!
1.13/0.69	45:06 INFO : 150 variables remaining out of 150
1.13/0.69	45:06 INFO : 102000 literals remaining out of 102000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311267-1304117105/watcher-3311267-1304117105 -o /tmp/evaluation-result-3311267-1304117105/solver-3311267-1304117105 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311267-1304117105.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.30 7.17 7.17 1/171 11292
/proc/meminfo: memFree=29691628/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=23028 CPUtime=0 cores=0,2,4,6
/proc/11292/stat : 11292 (java) R 11290 11292 10849 0 -1 4202496 749 0 0 0 0 0 0 0 25 0 1 0 504125831 23580672 235 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254256654101 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/11292/statm: 5757 248 199 9 0 124 0

[startup+0.0141491 s]
/proc/loadavg: 5.30 7.17 7.17 1/171 11292
/proc/meminfo: memFree=29691628/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15589660 CPUtime=0 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 2326 0 1 0 0 0 0 0 25 0 10 0 504125831 15963811840 1770 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16784584 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3897415 1772 974 9 0 3888571 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15589660

[startup+0.101173 s]
/proc/loadavg: 5.30 7.17 7.17 1/171 11292
/proc/meminfo: memFree=29691628/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15677128 CPUtime=0.11 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 5552 0 1 0 10 1 0 0 25 0 18 0 504125831 16053379072 4983 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3919282 4983 2117 9 0 3910001 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 15677128

[startup+0.301141 s]
/proc/loadavg: 5.30 7.17 7.17 1/171 11292
/proc/meminfo: memFree=29691628/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15680184 CPUtime=0.53 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 14599 0 1 0 52 1 0 0 25 0 18 0 504125831 16056508416 13139 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3920046 13144 2207 9 0 3910765 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 15680184

[startup+0.701364 s]
/proc/loadavg: 5.30 7.17 7.17 1/171 11292
/proc/meminfo: memFree=29691628/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15705688 CPUtime=1.43 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 37767 0 1 0 139 4 0 0 25 0 22 0 504125831 16082624512 33839 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3926422 33839 2248 9 0 3917141 0
Current children cumulated CPU time (s) 1.43
Current children cumulated vsize (KiB) 15705688

[startup+1.50089 s]
/proc/loadavg: 5.30 7.17 7.17 5/193 11314
/proc/meminfo: memFree=29533416/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15708176 CPUtime=4.42 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 63112 0 1 0 434 8 0 0 25 0 22 0 504125831 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3927044 54914 2274 9 0 3917763 0
[pid=11292/tid=11294] ppid=11290 vsize=15708176 CPUtime=0.67 cores=0,2,4,6
/proc/11292/task/11294/stat : 11294 (java) S 11290 11292 10849 0 -1 4202560 23356 0 1 0 65 2 0 0 20 0 22 0 504125831 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11295] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11295/stat : 11295 (java) S 11290 11292 10849 0 -1 4202560 951 0 0 0 0 0 0 0 16 0 22 0 504125832 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11296] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11296/stat : 11296 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 504125832 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11297] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11297/stat : 11297 (java) S 11290 11292 10849 0 -1 4202560 1056 0 0 0 0 0 0 0 16 0 22 0 504125832 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11298] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11298/stat : 11298 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 504125832 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11299] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11299/stat : 11299 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 504125832 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11300] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11300/stat : 11300 (java) S 11290 11292 10849 0 -1 4202560 734 0 0 0 1 0 0 0 15 0 22 0 504125832 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11301] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11301/stat : 11301 (java) S 11290 11292 10849 0 -1 4202560 2181 0 0 0 1 0 0 0 16 0 22 0 504125832 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11302] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11302/stat : 11302 (java) S 11290 11292 10849 0 -1 4202560 1685 0 0 0 1 0 0 0 16 0 22 0 504125832 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11303] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11303/stat : 11303 (java) S 11290 11292 10849 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 504125833 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 0 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11304] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11304/stat : 11304 (java) S 11290 11292 10849 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11305] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11305/stat : 11305 (java) S 11290 11292 10849 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11306] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11306/stat : 11306 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125835 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273440177 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11307] ppid=11290 vsize=15708176 CPUtime=0.66 cores=0,2,4,6
/proc/11292/task/11307/stat : 11307 (java) R 11290 11292 10849 0 -1 4202560 7459 0 0 0 65 1 0 0 17 0 22 0 504125835 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273442485 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=11292/tid=11308] ppid=11290 vsize=15708176 CPUtime=0.89 cores=0,2,4,6
/proc/11292/task/11308/stat : 11308 (java) R 11290 11292 10849 0 -1 4202560 12007 0 0 0 88 1 0 0 15 0 22 0 504125836 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 47112688571059 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=11292/tid=11309] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11309/stat : 11309 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125836 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11310] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11310/stat : 11310 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 504125836 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11311] ppid=11290 vsize=15708176 CPUtime=0.52 cores=0,2,4,6
/proc/11292/task/11311/stat : 11311 (java) R 11290 11292 10849 0 -1 4202560 3001 0 0 0 52 0 0 0 16 0 22 0 504125869 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505887579 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=11292/tid=11312] ppid=11290 vsize=15708176 CPUtime=0.45 cores=0,2,4,6
/proc/11292/task/11312/stat : 11312 (java) R 11290 11292 10849 0 -1 4202560 1057 0 0 0 45 0 0 0 16 0 22 0 504125869 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505918962 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=11292/tid=11313] ppid=11290 vsize=15708176 CPUtime=0.6 cores=0,2,4,6
/proc/11292/task/11313/stat : 11313 (java) R 11290 11292 10849 0 -1 4202560 5416 0 0 0 60 0 0 0 16 0 22 0 504125869 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505820497 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=11292/tid=11314] ppid=11290 vsize=15708176 CPUtime=0.49 cores=0,2,4,6
/proc/11292/task/11314/stat : 11314 (java) R 11290 11292 10849 0 -1 4202560 2747 0 0 0 49 0 0 0 16 0 22 0 504125869 16085172224 54914 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505970451 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.42
Current children cumulated vsize (KiB) 15708176

[startup+3.10161 s]
/proc/loadavg: 5.28 7.13 7.16 6/193 11314
/proc/meminfo: memFree=29324476/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15708176 CPUtime=10.79 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 149345 0 1 0 1059 20 0 0 25 0 22 0 504125831 16085172224 141117 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3927044 141121 2284 9 0 3917763 0
[pid=11292/tid=11294] ppid=11290 vsize=15708176 CPUtime=0.67 cores=0,2,4,6
/proc/11292/task/11294/stat : 11294 (java) S 11290 11292 10849 0 -1 4202560 23356 0 1 0 65 2 0 0 20 0 22 0 504125831 16085172224 141123 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11295] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11295/stat : 11295 (java) S 11290 11292 10849 0 -1 4202560 2863 0 0 0 0 0 0 0 15 0 22 0 504125832 16085172224 141126 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11296] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11296/stat : 11296 (java) S 11290 11292 10849 0 -1 4202560 3397 0 0 0 0 0 0 0 16 0 22 0 504125832 16085172224 141129 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11297] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11297/stat : 11297 (java) S 11290 11292 10849 0 -1 4202560 3573 0 0 0 0 0 0 0 15 0 22 0 504125832 16085172224 141132 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11298] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11298/stat : 11298 (java) S 11290 11292 10849 0 -1 4202560 1784 0 0 0 0 0 0 0 16 0 22 0 504125832 16085172224 141134 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11299] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11299/stat : 11299 (java) S 11290 11292 10849 0 -1 4202560 4614 0 0 0 1 0 0 0 16 0 22 0 504125832 16085172224 141136 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11300] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11300/stat : 11300 (java) S 11290 11292 10849 0 -1 4202560 734 0 0 0 1 0 0 0 15 0 22 0 504125832 16085172224 141141 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11301] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11301/stat : 11301 (java) S 11290 11292 10849 0 -1 4202560 4137 0 0 0 1 0 0 0 16 0 22 0 504125832 16085172224 141143 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11302] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11302/stat : 11302 (java) S 11290 11292 10849 0 -1 4202560 1685 0 0 0 1 0 0 0 15 0 22 0 504125832 16085172224 141153 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11303] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11303/stat : 11303 (java) S 11290 11292 10849 0 -1 4202560 200 0 0 0 0 0 0 0 15 0 22 0 504125833 16085172224 141162 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 0 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11304] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11304/stat : 11304 (java) S 11290 11292 10849 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 141170 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11305] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11305/stat : 11305 (java) S 11290 11292 10849 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 141172 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11306] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11306/stat : 11306 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125835 16085172224 141176 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273440177 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11307] ppid=11290 vsize=15708176 CPUtime=0.79 cores=0,2,4,6
/proc/11292/task/11307/stat : 11307 (java) S 11290 11292 10849 0 -1 4202560 7583 0 0 0 78 1 0 0 15 0 22 0 504125835 16085172224 141181 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11308] ppid=11290 vsize=15708176 CPUtime=1.09 cores=0,2,4,6
/proc/11292/task/11308/stat : 11308 (java) S 11290 11292 10849 0 -1 4202560 12057 0 0 0 108 1 0 0 15 0 22 0 504125836 16085172224 141183 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11309] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11309/stat : 11309 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125836 16085172224 141186 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11310] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11310/stat : 11310 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 504125836 16085172224 141189 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11311] ppid=11290 vsize=15708176 CPUtime=1.88 cores=0,2,4,6
/proc/11292/task/11311/stat : 11311 (java) R 11290 11292 10849 0 -1 4202560 20966 0 0 0 186 2 0 0 17 0 22 0 504125869 16085172224 141192 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505763930 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=11292/tid=11312] ppid=11290 vsize=15708176 CPUtime=1.93 cores=0,2,4,6
/proc/11292/task/11312/stat : 11312 (java) R 11290 11292 10849 0 -1 4202560 18352 0 0 0 191 2 0 0 17 0 22 0 504125869 16085172224 141195 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505841580 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=11292/tid=11313] ppid=11290 vsize=15708176 CPUtime=2.17 cores=0,2,4,6
/proc/11292/task/11313/stat : 11313 (java) R 11290 11292 10849 0 -1 4202560 22998 0 0 0 214 3 0 0 18 0 22 0 504125869 16085172224 141197 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505987249 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=11292/tid=11314] ppid=11290 vsize=15708176 CPUtime=2.07 cores=0,2,4,6
/proc/11292/task/11314/stat : 11314 (java) R 11290 11292 10849 0 -1 4202560 19742 0 0 0 205 2 0 0 17 0 22 0 504125869 16085172224 141201 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505809238 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10.79
Current children cumulated vsize (KiB) 15708176

[startup+6.30104 s]
/proc/loadavg: 5.28 7.13 7.16 5/193 11315
/proc/meminfo: memFree=28618000/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15708176 CPUtime=23.56 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 297470 0 1 0 2316 40 0 0 25 0 22 0 504125831 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3927044 288600 2284 9 0 3917763 0
[pid=11292/tid=11294] ppid=11290 vsize=15708176 CPUtime=0.67 cores=0,2,4,6
/proc/11292/task/11294/stat : 11294 (java) S 11290 11292 10849 0 -1 4202560 23356 0 1 0 65 2 0 0 20 0 22 0 504125831 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11295] ppid=11290 vsize=15708176 CPUtime=0.02 cores=0,2,4,6
/proc/11292/task/11295/stat : 11295 (java) S 11290 11292 10849 0 -1 4202560 7559 0 0 0 1 1 0 0 16 0 22 0 504125832 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11296] ppid=11290 vsize=15708176 CPUtime=0.02 cores=0,2,4,6
/proc/11292/task/11296/stat : 11296 (java) S 11290 11292 10849 0 -1 4202560 6056 0 0 0 1 1 0 0 15 0 22 0 504125832 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11297] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11297/stat : 11297 (java) S 11290 11292 10849 0 -1 4202560 3573 0 0 0 0 0 0 0 15 0 22 0 504125832 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11298] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11298/stat : 11298 (java) S 11290 11292 10849 0 -1 4202560 3227 0 0 0 1 0 0 0 15 0 22 0 504125832 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11299] ppid=11290 vsize=15708176 CPUtime=0.02 cores=0,2,4,6
/proc/11292/task/11299/stat : 11299 (java) S 11290 11292 10849 0 -1 4202560 7118 0 0 0 2 0 0 0 16 0 22 0 504125832 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11300] ppid=11290 vsize=15708176 CPUtime=0.02 cores=0,2,4,6
/proc/11292/task/11300/stat : 11300 (java) S 11290 11292 10849 0 -1 4202560 2989 0 0 0 2 0 0 0 16 0 22 0 504125832 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11301] ppid=11290 vsize=15708176 CPUtime=0.03 cores=0,2,4,6
/proc/11292/task/11301/stat : 11301 (java) S 11290 11292 10849 0 -1 4202560 6380 0 0 0 2 1 0 0 16 0 22 0 504125832 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11302] ppid=11290 vsize=15708176 CPUtime=0.01 cores=0,2,4,6
/proc/11292/task/11302/stat : 11302 (java) S 11290 11292 10849 0 -1 4202560 1685 0 0 0 1 0 0 0 15 0 22 0 504125832 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11303] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11303/stat : 11303 (java) S 11290 11292 10849 0 -1 4202560 971 0 0 0 0 0 0 0 15 0 22 0 504125833 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 0 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11304] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11304/stat : 11304 (java) S 11290 11292 10849 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11305] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11305/stat : 11305 (java) S 11290 11292 10849 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11306] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11306/stat : 11306 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125835 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273440177 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11307] ppid=11290 vsize=15708176 CPUtime=0.91 cores=0,2,4,6
/proc/11292/task/11307/stat : 11307 (java) S 11290 11292 10849 0 -1 4202560 7601 0 0 0 90 1 0 0 16 0 22 0 504125835 16085172224 288600 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=11292/tid=11312] ppid=11290 vsize=15708176 CPUtime=1108.79 cores=0,2,4,6
/proc/11292/task/11312/stat : 11312 (java) R 11290 11292 10849 0 -1 4202560 174214 0 0 0 110848 31 0 0 25 0 22 0 504125869 16085172224 83620 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505973630 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=11292/tid=11313] ppid=11290 vsize=15708176 CPUtime=1108.08 cores=0,2,4,6
/proc/11292/task/11313/stat : 11313 (java) R 11290 11292 10849 0 -1 4202560 180375 0 0 0 110779 29 0 0 25 0 22 0 504125869 16085172224 83620 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505809538 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=11292/tid=11314] ppid=11290 vsize=15708176 CPUtime=1108.09 cores=0,2,4,6
/proc/11292/task/11314/stat : 11314 (java) R 11290 11292 10849 0 -1 4202560 177126 0 0 0 110777 32 0 0 25 0 22 0 504125869 16085172224 83620 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505841159 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4462.91
Current children cumulated vsize (KiB) 15708176

[startup+1182.3 s]
/proc/loadavg: 4.11 4.11 4.90 5/193 11355
/proc/meminfo: memFree=29355904/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15708176 CPUtime=4701.53 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 1455612 0 1 0 469826 327 0 0 25 0 22 0 504125831 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3927044 83315 2298 9 0 3917763 0
[pid=11292/tid=11294] ppid=11290 vsize=15708176 CPUtime=0.67 cores=0,2,4,6
/proc/11292/task/11294/stat : 11294 (java) S 11290 11292 10849 0 -1 4202560 23356 0 1 0 65 2 0 0 20 0 22 0 504125831 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11295] ppid=11290 vsize=15708176 CPUtime=3.28 cores=0,2,4,6
/proc/11292/task/11295/stat : 11295 (java) S 11290 11292 10849 0 -1 4202560 84895 0 0 0 313 15 0 0 15 0 22 0 504125832 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11296] ppid=11290 vsize=15708176 CPUtime=3.25 cores=0,2,4,6
/proc/11292/task/11296/stat : 11296 (java) S 11290 11292 10849 0 -1 4202560 80627 0 0 0 310 15 0 0 15 0 22 0 504125832 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11297] ppid=11290 vsize=15708176 CPUtime=3.41 cores=0,2,4,6
/proc/11292/task/11297/stat : 11297 (java) S 11290 11292 10849 0 -1 4202560 81346 0 0 0 325 16 0 0 16 0 22 0 504125832 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11298] ppid=11290 vsize=15708176 CPUtime=3.38 cores=0,2,4,6
/proc/11292/task/11298/stat : 11298 (java) S 11290 11292 10849 0 -1 4202560 81016 0 0 0 322 16 0 0 15 0 22 0 504125832 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11299] ppid=11290 vsize=15708176 CPUtime=3.39 cores=0,2,4,6
/proc/11292/task/11299/stat : 11299 (java) S 11290 11292 10849 0 -1 4202560 83173 0 0 0 324 15 0 0 15 0 22 0 504125832 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11300] ppid=11290 vsize=15708176 CPUtime=3.37 cores=0,2,4,6
/proc/11292/task/11300/stat : 11300 (java) S 11290 11292 10849 0 -1 4202560 79782 0 0 0 322 15 0 0 15 0 22 0 504125832 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11301] ppid=11290 vsize=15708176 CPUtime=3.35 cores=0,2,4,6
/proc/11292/task/11301/stat : 11301 (java) S 11290 11292 10849 0 -1 4202560 84932 0 0 0 319 16 0 0 15 0 22 0 504125832 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11302] ppid=11290 vsize=15708176 CPUtime=3.41 cores=0,2,4,6
/proc/11292/task/11302/stat : 11302 (java) S 11290 11292 10849 0 -1 4202560 80991 0 0 0 325 16 0 0 15 0 22 0 504125832 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11303] ppid=11290 vsize=15708176 CPUtime=1.73 cores=0,2,4,6
/proc/11292/task/11303/stat : 11303 (java) S 11290 11292 10849 0 -1 4202560 3558 0 0 0 107 66 0 0 15 0 22 0 504125833 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 0 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11304] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11304/stat : 11304 (java) S 11290 11292 10849 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11305] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11305/stat : 11305 (java) S 11290 11292 10849 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11306] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11306/stat : 11306 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125835 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273440177 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11307] ppid=11290 vsize=15708176 CPUtime=0.94 cores=0,2,4,6
/proc/11292/task/11307/stat : 11307 (java) S 11290 11292 10849 0 -1 4202560 7611 0 0 0 93 1 0 0 15 0 22 0 504125835 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11308] ppid=11290 vsize=15708176 CPUtime=1.29 cores=0,2,4,6
/proc/11292/task/11308/stat : 11308 (java) S 11290 11292 10849 0 -1 4202560 12085 0 0 0 128 1 0 0 15 0 22 0 504125836 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11309] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11309/stat : 11309 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125836 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11310] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11310/stat : 11310 (java) S 11290 11292 10849 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 504125836 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11311] ppid=11290 vsize=15708176 CPUtime=1166.97 cores=0,2,4,6
/proc/11292/task/11311/stat : 11311 (java) R 11290 11292 10849 0 -1 4202560 189587 0 0 0 116668 29 0 0 25 0 22 0 504125869 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 47112687941890 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=11292/tid=11312] ppid=11290 vsize=15708176 CPUtime=1168.13 cores=0,2,4,6
/proc/11292/task/11312/stat : 11312 (java) R 11290 11292 10849 0 -1 4202560 183922 0 0 0 116780 33 0 0 25 0 22 0 504125869 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505738053 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=11292/tid=11313] ppid=11290 vsize=15708176 CPUtime=1167.4 cores=0,2,4,6
/proc/11292/task/11313/stat : 11313 (java) R 11290 11292 10849 0 -1 4202560 190373 0 0 0 116709 31 0 0 25 0 22 0 504125869 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505840464 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=11292/tid=11314] ppid=11290 vsize=15708176 CPUtime=1167.4 cores=0,2,4,6
/proc/11292/task/11314/stat : 11314 (java) R 11290 11292 10849 0 -1 4202560 186903 0 0 0 116707 33 0 0 25 0 22 0 504125869 16085172224 83315 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505738266 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4701.53
Current children cumulated vsize (KiB) 15708176



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.1 s]
/proc/loadavg: 4.07 4.09 4.87 5/193 11356
/proc/meminfo: memFree=29351908/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15708176 CPUtime=4800.17 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 1484425 0 1 0 479684 333 0 0 25 0 22 0 504125831 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3927044 85576 2298 9 0 3917763 0
[pid=11292/tid=11294] ppid=11290 vsize=15708176 CPUtime=0.67 cores=0,2,4,6
/proc/11292/task/11294/stat : 11294 (java) S 11290 11292 10849 0 -1 4202560 23356 0 1 0 65 2 0 0 20 0 22 0 504125831 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11295] ppid=11290 vsize=15708176 CPUtime=3.35 cores=0,2,4,6
/proc/11292/task/11295/stat : 11295 (java) S 11290 11292 10849 0 -1 4202560 87523 0 0 0 320 15 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11296] ppid=11290 vsize=15708176 CPUtime=3.33 cores=0,2,4,6
/proc/11292/task/11296/stat : 11296 (java) S 11290 11292 10849 0 -1 4202560 82766 0 0 0 317 16 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11297] ppid=11290 vsize=15708176 CPUtime=3.48 cores=0,2,4,6
/proc/11292/task/11297/stat : 11297 (java) S 11290 11292 10849 0 -1 4202560 84018 0 0 0 332 16 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11298] ppid=11290 vsize=15708176 CPUtime=3.46 cores=0,2,4,6
/proc/11292/task/11298/stat : 11298 (java) S 11290 11292 10849 0 -1 4202560 83442 0 0 0 330 16 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11299] ppid=11290 vsize=15708176 CPUtime=3.46 cores=0,2,4,6
/proc/11292/task/11299/stat : 11299 (java) S 11290 11292 10849 0 -1 4202560 85399 0 0 0 331 15 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11300] ppid=11290 vsize=15708176 CPUtime=3.43 cores=0,2,4,6
/proc/11292/task/11300/stat : 11300 (java) S 11290 11292 10849 0 -1 4202560 82748 0 0 0 328 15 0 0 16 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11301] ppid=11290 vsize=15708176 CPUtime=3.43 cores=0,2,4,6
/proc/11292/task/11301/stat : 11301 (java) S 11290 11292 10849 0 -1 4202560 87599 0 0 0 326 17 0 0 16 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11302] ppid=11290 vsize=15708176 CPUtime=3.48 cores=0,2,4,6
/proc/11292/task/11302/stat : 11302 (java) S 11290 11292 10849 0 -1 4202560 83731 0 0 0 332 16 0 0 16 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11303] ppid=11290 vsize=15708176 CPUtime=1.75 cores=0,2,4,6
/proc/11292/task/11303/stat : 11303 (java) S 11290 11292 10849 0 -1 4202560 3640 0 0 0 108 67 0 0 15 0 22 0 504125833 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 0 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11304] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11304/stat : 11304 (java) S 11290 11292 10849 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11305] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11305/stat : 11305 (java) S 11290 11292 10849 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11306] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11306/stat : 11306 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125835 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273440177 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11307] ppid=11290 vsize=15708176 CPUtime=0.94 cores=0,2,4,6
/proc/11292/task/11307/stat : 11307 (java) S 11290 11292 10849 0 -1 4202560 7611 0 0 0 93 1 0 0 15 0 22 0 504125835 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11308] ppid=11290 vsize=15708176 CPUtime=1.29 cores=0,2,4,6
/proc/11292/task/11308/stat : 11308 (java) S 11290 11292 10849 0 -1 4202560 12085 0 0 0 128 1 0 0 15 0 22 0 504125836 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11309] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11309/stat : 11309 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125836 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11310] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11310/stat : 11310 (java) S 11290 11292 10849 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 504125836 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11311] ppid=11290 vsize=15708176 CPUtime=1191.37 cores=0,2,4,6
/proc/11292/task/11311/stat : 11311 (java) R 11290 11292 10849 0 -1 4202560 191406 0 0 0 119108 29 0 0 25 0 22 0 504125869 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 47112687941517 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=11292/tid=11312] ppid=11290 vsize=15708176 CPUtime=1192.68 cores=0,2,4,6
/proc/11292/task/11312/stat : 11312 (java) R 11290 11292 10849 0 -1 4202560 186017 0 0 0 119234 34 0 0 25 0 22 0 504125869 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505605996 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=11292/tid=11313] ppid=11290 vsize=15708176 CPUtime=1191.94 cores=0,2,4,6
/proc/11292/task/11313/stat : 11313 (java) R 11290 11292 10849 0 -1 4202560 192401 0 0 0 119163 31 0 0 25 0 22 0 504125869 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505723846 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=11292/tid=11314] ppid=11290 vsize=15708176 CPUtime=1191.94 cores=0,2,4,6
/proc/11292/task/11314/stat : 11314 (java) R 11290 11292 10849 0 -1 4202560 189226 0 0 0 119161 33 0 0 25 0 22 0 504125869 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505820216 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 15708176

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.1 s]
/proc/loadavg: 4.07 4.09 4.87 5/193 11356
/proc/meminfo: memFree=29351908/32951124 swapFree=67111348/67111528
[pid=11292] ppid=11290 vsize=15708176 CPUtime=4800.17 cores=0,2,4,6
/proc/11292/stat : 11292 (java) S 11290 11292 10849 0 -1 4202496 1484425 0 1 0 479684 333 0 0 25 0 22 0 504125831 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273419237 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/11292/statm: 3927044 85576 2298 9 0 3917763 0
[pid=11292/tid=11294] ppid=11290 vsize=15708176 CPUtime=0.67 cores=0,2,4,6
/proc/11292/task/11294/stat : 11294 (java) S 11290 11292 10849 0 -1 4202560 23356 0 1 0 65 2 0 0 20 0 22 0 504125831 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11295] ppid=11290 vsize=15708176 CPUtime=3.35 cores=0,2,4,6
/proc/11292/task/11295/stat : 11295 (java) S 11290 11292 10849 0 -1 4202560 87523 0 0 0 320 15 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11296] ppid=11290 vsize=15708176 CPUtime=3.33 cores=0,2,4,6
/proc/11292/task/11296/stat : 11296 (java) S 11290 11292 10849 0 -1 4202560 82766 0 0 0 317 16 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11297] ppid=11290 vsize=15708176 CPUtime=3.48 cores=0,2,4,6
/proc/11292/task/11297/stat : 11297 (java) S 11290 11292 10849 0 -1 4202560 84018 0 0 0 332 16 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11298] ppid=11290 vsize=15708176 CPUtime=3.46 cores=0,2,4,6
/proc/11292/task/11298/stat : 11298 (java) S 11290 11292 10849 0 -1 4202560 83442 0 0 0 330 16 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11299] ppid=11290 vsize=15708176 CPUtime=3.46 cores=0,2,4,6
/proc/11292/task/11299/stat : 11299 (java) S 11290 11292 10849 0 -1 4202560 85399 0 0 0 331 15 0 0 15 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11300] ppid=11290 vsize=15708176 CPUtime=3.43 cores=0,2,4,6
/proc/11292/task/11300/stat : 11300 (java) S 11290 11292 10849 0 -1 4202560 82748 0 0 0 328 15 0 0 16 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11301] ppid=11290 vsize=15708176 CPUtime=3.43 cores=0,2,4,6
/proc/11292/task/11301/stat : 11301 (java) S 11290 11292 10849 0 -1 4202560 87599 0 0 0 326 17 0 0 16 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11302] ppid=11290 vsize=15708176 CPUtime=3.48 cores=0,2,4,6
/proc/11292/task/11302/stat : 11302 (java) S 11290 11292 10849 0 -1 4202560 83731 0 0 0 332 16 0 0 16 0 22 0 504125832 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11303] ppid=11290 vsize=15708176 CPUtime=1.75 cores=0,2,4,6
/proc/11292/task/11303/stat : 11303 (java) S 11290 11292 10849 0 -1 4202560 3640 0 0 0 108 67 0 0 15 0 22 0 504125833 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 0 0 16800975 18446604453956682048 0 0 -1 0 0 0 0
[pid=11292/tid=11304] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11304/stat : 11304 (java) S 11290 11292 10849 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11305] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11305/stat : 11305 (java) S 11290 11292 10849 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 504125833 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11306] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11306/stat : 11306 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125835 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273440177 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11307] ppid=11290 vsize=15708176 CPUtime=0.94 cores=0,2,4,6
/proc/11292/task/11307/stat : 11307 (java) S 11290 11292 10849 0 -1 4202560 7611 0 0 0 93 1 0 0 15 0 22 0 504125835 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 2 0 0 0
[pid=11292/tid=11308] ppid=11290 vsize=15708176 CPUtime=1.29 cores=0,2,4,6
/proc/11292/task/11308/stat : 11308 (java) S 11290 11292 10849 0 -1 4202560 12085 0 0 0 128 1 0 0 15 0 22 0 504125836 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 6 0 0 0
[pid=11292/tid=11309] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11309/stat : 11309 (java) S 11290 11292 10849 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 504125836 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273432473 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11310] ppid=11290 vsize=15708176 CPUtime=0 cores=0,2,4,6
/proc/11292/task/11310/stat : 11310 (java) S 11290 11292 10849 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 504125836 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 254273433088 0 4 0 16800975 18446604453956682048 0 0 -1 4 0 0 0
[pid=11292/tid=11311] ppid=11290 vsize=15708176 CPUtime=1191.37 cores=0,2,4,6
/proc/11292/task/11311/stat : 11311 (java) R 11290 11292 10849 0 -1 4202560 191406 0 0 0 119108 29 0 0 25 0 22 0 504125869 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 47112687941517 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=11292/tid=11312] ppid=11290 vsize=15708176 CPUtime=1192.68 cores=0,2,4,6
/proc/11292/task/11312/stat : 11312 (java) R 11290 11292 10849 0 -1 4202560 186017 0 0 0 119234 34 0 0 25 0 22 0 504125869 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505605996 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=11292/tid=11313] ppid=11290 vsize=15708176 CPUtime=1191.94 cores=0,2,4,6
/proc/11292/task/11313/stat : 11313 (java) R 11290 11292 10849 0 -1 4202560 192401 0 0 0 119163 31 0 0 25 0 22 0 504125869 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505723846 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=11292/tid=11314] ppid=11290 vsize=15708176 CPUtime=1191.94 cores=0,2,4,6
/proc/11292/task/11314/stat : 11314 (java) R 11290 11292 10849 0 -1 4202560 189226 0 0 0 119161 33 0 0 25 0 22 0 504125869 16085172224 85576 33554432000 1073741824 1073778376 140736846270144 18446744073709551615 46912505820216 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 15708176

Child status: 143
Real time (s): 1207.13
CPU time (s): 4800.23
CPU user time (s): 4796.88
CPU system time (s): 3.35249
CPU usage (%): 397.656
Max. virtual memory (cumulated for all children) (KiB): 15710956

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.88
system time used= 3.35249
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1484451
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 254204
involuntary context switches= 135344

runsolver used 2.09268 second user time and 4.54131 second system time

The end

Launcher Data 

Begin job on node140 at 2011-04-30 00:45:05
IDJOB=3311267
IDBENCH=82652
IDSOLVER=1698
FILE ID=node140/3311267-1304117105
RUNJOBID= node140-1304113387-10867
PBS_JOBID= 13170700
Free space on /tmp= 72664 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/large/unif-k7-r85-v150-c12750-S1101422472-003-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311267-1304117105/watcher-3311267-1304117105 -o /tmp/evaluation-result-3311267-1304117105/solver-3311267-1304117105 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311267-1304117105.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1a4e1674582e40801444509cae2068da
RANDOM SEED=43752115

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29691908 kB
Buffers:       1014592 kB
Cached:        1693088 kB
SwapCached:        180 kB
Active:         269092 kB
Inactive:      2501044 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29691908 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            2020 kB
Writeback:           0 kB
AnonPages:       61916 kB
Mapped:          14704 kB
Slab:           426500 kB
PageTables:       4028 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   184020 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72660 MiB
End job on node140 at 2011-04-30 01:05:14