Trace number 3311616

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.41 1207.43

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v500-c2130-S247862791-097.UNKNOWN.cnf
MD5SUM6b69f72e1046222baee8c8d817a4adac
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark485.529
Satisfiable
(Un)Satisfiability was proved
Number of variables500
Number of clauses2130
Sum of the clauses size6390
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32130
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.11/0.12	27:10 INFO : Reading from input HOME/instance-3311616-1304177230.cnf
0.27/0.25	Executor set job limit to 1000000
0.27/0.25	Executor set job limit to 1000000
0.27/0.25	Executor set job limit to 1000000
0.27/0.25	Executor set job limit to 1000000
0.27/0.25	Starting Executor!
0.27/0.25	Starting Executor!
0.27/0.25	Starting Executor!
0.27/0.25	Starting Executor!
0.46/0.35	27:10 INFO : 499 variables remaining out of 500
0.46/0.35	27:10 INFO : 8512 literals remaining out of 8520

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311616-1304177230/watcher-3311616-1304177230 -o /tmp/evaluation-result-3311616-1304177230/solver-3311616-1304177230 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311616-1304177230.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.97 7.93 7.95 5/198 681
/proc/meminfo: memFree=22844828/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=308 CPUtime=0 cores=1,3,5,7
/proc/681/stat : 681 (java) R 679 681 510 0 -1 4194304 363 0 0 0 0 0 0 0 25 0 1 0 607953641 315392 40 33554432000 1073741824 1073778376 140733297095440 18446744073709551615 216730255370 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/681/statm: 616 44 35 9 0 27 0

[startup+0.0726559 s]
/proc/loadavg: 7.97 7.93 7.95 5/198 681
/proc/meminfo: memFree=22844828/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15610528 CPUtime=0.06 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 4401 0 1 0 5 1 0 0 25 0 18 0 607953641 15985180672 3840 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3902632 3840 1779 9 0 3893351 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 15610528

[startup+0.104457 s]
/proc/loadavg: 7.97 7.93 7.95 5/198 681
/proc/meminfo: memFree=22844828/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15677088 CPUtime=0.11 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 5588 0 1 0 9 2 0 0 25 0 18 0 607953641 16053338112 4999 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3919272 4999 2116 9 0 3909991 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 15677088

[startup+0.300833 s]
/proc/loadavg: 7.97 7.93 7.95 5/198 681
/proc/meminfo: memFree=22844828/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15683248 CPUtime=0.46 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 8911 0 1 0 44 2 0 0 25 0 22 0 607953641 16059645952 8306 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3920812 8306 2220 9 0 3911531 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 15683248

[startup+0.76872 s]
/proc/loadavg: 7.97 7.93 7.95 5/198 681
/proc/meminfo: memFree=22844828/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15706416 CPUtime=2.08 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 31440 0 1 0 202 6 0 0 25 0 22 0 607953641 16083369984 26923 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3926604 26923 2257 9 0 3917323 0
Current children cumulated CPU time (s) 2.08
Current children cumulated vsize (KiB) 15706416

[startup+1.50159 s]
/proc/loadavg: 7.97 7.93 7.95 11/220 703
/proc/meminfo: memFree=22727348/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15706416 CPUtime=5 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 44557 0 1 0 493 7 0 0 25 0 22 0 607953641 16083369984 40039 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3926604 40039 2257 9 0 3917323 0
[pid=681/tid=683] ppid=679 vsize=15706416 CPUtime=0.34 cores=1,3,5,7
/proc/681/task/683/stat : 683 (java) S 679 681 510 0 -1 4202560 6233 0 1 0 32 2 0 0 20 0 22 0 607953642 16083369984 40039 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=684] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/684/stat : 684 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953643 16083369984 40039 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=685] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/685/stat : 685 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953643 16083369984 40039 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=686] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/686/stat : 686 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953643 16083369984 40039 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=687] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/687/stat : 687 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953643 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=688] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/688/stat : 688 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953643 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=689] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/689/stat : 689 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953643 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=690] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/690/stat : 690 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953643 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=691] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/691/stat : 691 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953643 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=692] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/692/stat : 692 (java) S 679 681 510 0 -1 4202560 6 0 0 0 0 0 0 0 18 0 22 0 607953644 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 0 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=693] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/693/stat : 693 (java) S 679 681 510 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 22 0 607953644 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=694] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/694/stat : 694 (java) S 679 681 510 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 22 0 607953644 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=695] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/695/stat : 695 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216747002289 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=696] ppid=679 vsize=15706416 CPUtime=0.45 cores=1,3,5,7
/proc/681/task/696/stat : 696 (java) R 679 681 510 0 -1 4202560 9433 0 0 0 44 1 0 0 18 0 22 0 607953646 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 47505905530300 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=681/tid=697] ppid=679 vsize=15706416 CPUtime=0.31 cores=1,3,5,7
/proc/681/task/697/stat : 697 (java) R 679 681 510 0 -1 4202560 6167 0 0 0 31 0 0 0 25 0 22 0 607953646 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 47505904022033 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=681/tid=698] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/698/stat : 698 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=699] ppid=679 vsize=15706416 CPUtime=0 cores=1,3,5,7
/proc/681/task/699/stat : 699 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 607953646 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=700] ppid=679 vsize=15706416 CPUtime=1.08 cores=1,3,5,7
/proc/681/task/700/stat : 700 (java) R 679 681 510 0 -1 4202560 5883 0 0 0 108 0 0 0 20 0 22 0 607953666 16083369984 40040 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505621168 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=681/tid=701] ppid=679 vsize=15706416 CPUtime=0.83 cores=1,3,5,7
/proc/681/task/701/stat : 701 (java) R 679 681 510 0 -1 4202560 4638 0 0 0 83 0 0 0 17 0 22 0 607953667 16083369984 40041 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505179312 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=681/tid=702] ppid=679 vsize=15706416 CPUtime=0.9 cores=1,3,5,7
/proc/681/task/702/stat : 702 (java) R 679 681 510 0 -1 4202560 4808 0 0 0 90 0 0 0 18 0 22 0 607953667 16083369984 40041 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 47505904698234 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=681/tid=703] ppid=679 vsize=15706416 CPUtime=1.02 cores=1,3,5,7
/proc/681/task/703/stat : 703 (java) R 679 681 510 0 -1 4202560 5998 0 0 0 102 0 0 0 20 0 22 0 607953667 16083369984 40041 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505227952 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5
Current children cumulated vsize (KiB) 15706416

[startup+3.10132 s]
/proc/loadavg: 8.22 7.98 7.96 12/220 703
/proc/meminfo: memFree=22654312/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15706196 CPUtime=11.39 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 63741 0 1 0 1129 10 0 0 25 0 22 0 607953641 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3926549 55159 2276 9 0 3917268 0
[pid=681/tid=683] ppid=679 vsize=15706196 CPUtime=0.34 cores=1,3,5,7
/proc/681/task/683/stat : 683 (java) S 679 681 510 0 -1 4202560 6233 0 1 0 32 2 0 0 20 0 22 0 607953642 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=684] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/684/stat : 684 (java) S 679 681 510 0 -1 4202560 1145 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=685] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/685/stat : 685 (java) S 679 681 510 0 -1 4202560 54 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=686] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/686/stat : 686 (java) S 679 681 510 0 -1 4202560 829 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=687] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/687/stat : 687 (java) S 679 681 510 0 -1 4202560 19 0 0 0 0 0 0 0 16 0 22 0 607953643 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=688] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/688/stat : 688 (java) S 679 681 510 0 -1 4202560 21 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=689] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/689/stat : 689 (java) S 679 681 510 0 -1 4202560 18 0 0 0 0 0 0 0 16 0 22 0 607953643 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=690] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/690/stat : 690 (java) S 679 681 510 0 -1 4202560 1326 0 0 0 0 0 0 0 16 0 22 0 607953643 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=691] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/691/stat : 691 (java) S 679 681 510 0 -1 4202560 971 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=692] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/692/stat : 692 (java) S 679 681 510 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 607953644 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 0 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=693] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/693/stat : 693 (java) S 679 681 510 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=694] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/694/stat : 694 (java) S 679 681 510 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=695] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/695/stat : 695 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216747002289 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=696] ppid=679 vsize=15706196 CPUtime=1.36 cores=1,3,5,7
/proc/681/task/696/stat : 696 (java) S 679 681 510 0 -1 4202560 12747 0 0 0 134 2 0 0 16 0 22 0 607953646 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=697] ppid=679 vsize=15706196 CPUtime=0.66 cores=1,3,5,7
/proc/681/task/697/stat : 697 (java) R 679 681 510 0 -1 4202560 9440 0 0 0 65 1 0 0 25 0 22 0 607953646 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=681/tid=698] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/698/stat : 698 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=699] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/699/stat : 699 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 607953646 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=700] ppid=679 vsize=15706196 CPUtime=2.34 cores=1,3,5,7
/proc/681/task/700/stat : 700 (java) R 679 681 510 0 -1 4202560 7893 0 0 0 234 0 0 0 18 0 22 0 607953666 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 47505908499178 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=681/tid=701] ppid=679 vsize=15706196 CPUtime=2.16 cores=1,3,5,7
/proc/681/task/701/stat : 701 (java) R 679 681 510 0 -1 4202560 6748 0 0 0 216 0 0 0 19 0 22 0 607953667 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505592100 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=681/tid=702] ppid=679 vsize=15706196 CPUtime=2.33 cores=1,3,5,7
/proc/681/task/702/stat : 702 (java) R 679 681 510 0 -1 4202560 6091 0 0 0 233 0 0 0 21 0 22 0 607953667 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505730560 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=681/tid=703] ppid=679 vsize=15706196 CPUtime=2.1 cores=1,3,5,7
/proc/681/task/703/stat : 703 (java) R 679 681 510 0 -1 4202560 8746 0 0 0 210 0 0 0 23 0 22 0 607953667 16083144704 55159 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 47505908500797 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.39
Current children cumulated vsize (KiB) 15706196

[startup+6.30076 s]
/proc/loadavg: 8.22 7.98 7.96 9/220 704
/proc/meminfo: memFree=22266692/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15706196 CPUtime=24.15 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 159940 0 1 0 2392 23 0 0 25 0 22 0 607953641 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3926549 147572 2276 9 0 3917268 0
[pid=681/tid=683] ppid=679 vsize=15706196 CPUtime=0.34 cores=1,3,5,7
/proc/681/task/683/stat : 683 (java) S 679 681 510 0 -1 4202560 6233 0 1 0 32 2 0 0 20 0 22 0 607953642 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=684] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/684/stat : 684 (java) S 679 681 510 0 -1 4202560 1813 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=685] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/685/stat : 685 (java) S 679 681 510 0 -1 4202560 644 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=686] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/686/stat : 686 (java) S 679 681 510 0 -1 4202560 1579 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=687] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/687/stat : 687 (java) S 679 681 510 0 -1 4202560 710 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=688] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/688/stat : 688 (java) S 679 681 510 0 -1 4202560 1171 0 0 0 0 0 0 0 15 0 22 0 607953643 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=689] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/689/stat : 689 (java) S 679 681 510 0 -1 4202560 580 0 0 0 0 0 0 0 16 0 22 0 607953643 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=690] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/690/stat : 690 (java) S 679 681 510 0 -1 4202560 3091 0 0 0 0 0 0 0 16 0 22 0 607953643 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=691] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/691/stat : 691 (java) S 679 681 510 0 -1 4202560 1629 0 0 0 0 0 0 0 16 0 22 0 607953643 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=692] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/692/stat : 692 (java) S 679 681 510 0 -1 4202560 201 0 0 0 0 0 0 0 15 0 22 0 607953644 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 0 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=693] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/693/stat : 693 (java) S 679 681 510 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=694] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/694/stat : 694 (java) S 679 681 510 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=695] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/695/stat : 695 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216747002289 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=696] ppid=679 vsize=15706196 CPUtime=1.43 cores=1,3,5,7
/proc/681/task/696/stat : 696 (java) S 679 681 510 0 -1 4202560 12759 0 0 0 141 2 0 0 15 0 22 0 607953646 16083144704 147572 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0

################
# More data... #
################

[pid=681/tid=701] ppid=679 vsize=15706196 CPUtime=1048.39 cores=1,3,5,7
/proc/681/task/701/stat : 701 (java) R 679 681 510 0 -1 4202560 319744 0 0 0 104788 51 0 0 25 0 22 0 607953667 16083144704 98168 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505523269 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=681/tid=702] ppid=679 vsize=15706196 CPUtime=1048.3 cores=1,3,5,7
/proc/681/task/702/stat : 702 (java) R 679 681 510 0 -1 4202560 322539 0 0 0 104782 48 0 0 25 0 22 0 607953667 16083144704 98168 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505829840 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=681/tid=703] ppid=679 vsize=15706196 CPUtime=1047.76 cores=1,3,5,7
/proc/681/task/703/stat : 703 (java) R 679 681 510 0 -1 4202560 326432 0 0 0 104728 48 0 0 25 0 22 0 607953667 16083144704 98168 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505656259 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4223.39
Current children cumulated vsize (KiB) 15706196

[startup+1122.3 s]
/proc/loadavg: 7.92 8.03 8.01 9/220 789
/proc/meminfo: memFree=22375792/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15706196 CPUtime=4461.97 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 2430220 0 1 0 445705 492 0 0 25 0 22 0 607953641 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3926549 97373 2297 9 0 3917268 0
[pid=681/tid=683] ppid=679 vsize=15706196 CPUtime=0.34 cores=1,3,5,7
/proc/681/task/683/stat : 683 (java) S 679 681 510 0 -1 4202560 6233 0 1 0 32 2 0 0 20 0 22 0 607953642 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=684] ppid=679 vsize=15706196 CPUtime=3.29 cores=1,3,5,7
/proc/681/task/684/stat : 684 (java) S 679 681 510 0 -1 4202560 131014 0 0 0 304 25 0 0 16 0 22 0 607953643 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=685] ppid=679 vsize=15706196 CPUtime=3.3 cores=1,3,5,7
/proc/681/task/685/stat : 685 (java) S 679 681 510 0 -1 4202560 135100 0 0 0 305 25 0 0 16 0 22 0 607953643 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=686] ppid=679 vsize=15706196 CPUtime=3.19 cores=1,3,5,7
/proc/681/task/686/stat : 686 (java) S 679 681 510 0 -1 4202560 120240 0 0 0 294 25 0 0 16 0 22 0 607953643 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=687] ppid=679 vsize=15706196 CPUtime=3.3 cores=1,3,5,7
/proc/681/task/687/stat : 687 (java) S 679 681 510 0 -1 4202560 126557 0 0 0 308 22 0 0 15 0 22 0 607953643 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=688] ppid=679 vsize=15706196 CPUtime=3.36 cores=1,3,5,7
/proc/681/task/688/stat : 688 (java) S 679 681 510 0 -1 4202560 131041 0 0 0 312 24 0 0 15 0 22 0 607953643 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=689] ppid=679 vsize=15706196 CPUtime=3.32 cores=1,3,5,7
/proc/681/task/689/stat : 689 (java) S 679 681 510 0 -1 4202560 129208 0 0 0 309 23 0 0 15 0 22 0 607953643 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=690] ppid=679 vsize=15706196 CPUtime=3.23 cores=1,3,5,7
/proc/681/task/690/stat : 690 (java) S 679 681 510 0 -1 4202560 127374 0 0 0 300 23 0 0 15 0 22 0 607953643 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=691] ppid=679 vsize=15706196 CPUtime=3.25 cores=1,3,5,7
/proc/681/task/691/stat : 691 (java) S 679 681 510 0 -1 4202560 127814 0 0 0 300 25 0 0 15 0 22 0 607953643 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=692] ppid=679 vsize=15706196 CPUtime=2.22 cores=1,3,5,7
/proc/681/task/692/stat : 692 (java) S 679 681 510 0 -1 4202560 6385 0 0 0 140 82 0 0 15 0 22 0 607953644 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 0 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=693] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/693/stat : 693 (java) S 679 681 510 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=694] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/694/stat : 694 (java) S 679 681 510 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=695] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/695/stat : 695 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216747002289 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=696] ppid=679 vsize=15706196 CPUtime=1.55 cores=1,3,5,7
/proc/681/task/696/stat : 696 (java) S 679 681 510 0 -1 4202560 12801 0 0 0 153 2 0 0 15 0 22 0 607953646 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=697] ppid=679 vsize=15706196 CPUtime=0.79 cores=1,3,5,7
/proc/681/task/697/stat : 697 (java) S 679 681 510 0 -1 4202560 9460 0 0 0 78 1 0 0 15 0 22 0 607953646 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=698] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/698/stat : 698 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=699] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/699/stat : 699 (java) S 679 681 510 0 -1 4202560 62 0 0 0 0 0 0 0 15 0 22 0 607953646 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=700] ppid=679 vsize=15706196 CPUtime=1108.55 cores=1,3,5,7
/proc/681/task/700/stat : 700 (java) R 679 681 510 0 -1 4202560 342565 0 0 0 110803 52 0 0 25 0 22 0 607953666 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505829822 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=681/tid=701] ppid=679 vsize=15706196 CPUtime=1107.6 cores=1,3,5,7
/proc/681/task/701/stat : 701 (java) R 679 681 510 0 -1 4202560 337656 0 0 0 110706 54 0 0 25 0 22 0 607953667 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505668409 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=681/tid=702] ppid=679 vsize=15706196 CPUtime=1107.6 cores=1,3,5,7
/proc/681/task/702/stat : 702 (java) R 679 681 510 0 -1 4202560 340431 0 0 0 110710 50 0 0 25 0 22 0 607953667 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505831254 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=681/tid=703] ppid=679 vsize=15706196 CPUtime=1106.96 cores=1,3,5,7
/proc/681/task/703/stat : 703 (java) R 679 681 510 0 -1 4202560 344894 0 0 0 110645 51 0 0 25 0 22 0 607953667 16083144704 97373 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505829753 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4461.97
Current children cumulated vsize (KiB) 15706196

[startup+1182.3 s]
/proc/loadavg: 8.08 8.05 8.01 9/220 791
/proc/meminfo: memFree=22551232/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15706196 CPUtime=4700.49 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 2558864 0 1 0 469532 517 0 0 25 0 22 0 607953641 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3926549 96495 2297 9 0 3917268 0
[pid=681/tid=683] ppid=679 vsize=15706196 CPUtime=0.34 cores=1,3,5,7
/proc/681/task/683/stat : 683 (java) S 679 681 510 0 -1 4202560 6233 0 1 0 32 2 0 0 20 0 22 0 607953642 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=684] ppid=679 vsize=15706196 CPUtime=3.46 cores=1,3,5,7
/proc/681/task/684/stat : 684 (java) S 679 681 510 0 -1 4202560 137310 0 0 0 320 26 0 0 15 0 22 0 607953643 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=685] ppid=679 vsize=15706196 CPUtime=3.48 cores=1,3,5,7
/proc/681/task/685/stat : 685 (java) S 679 681 510 0 -1 4202560 142536 0 0 0 322 26 0 0 15 0 22 0 607953643 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=686] ppid=679 vsize=15706196 CPUtime=3.36 cores=1,3,5,7
/proc/681/task/686/stat : 686 (java) S 679 681 510 0 -1 4202560 126788 0 0 0 310 26 0 0 16 0 22 0 607953643 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=687] ppid=679 vsize=15706196 CPUtime=3.45 cores=1,3,5,7
/proc/681/task/687/stat : 687 (java) S 679 681 510 0 -1 4202560 132555 0 0 0 322 23 0 0 15 0 22 0 607953643 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=688] ppid=679 vsize=15706196 CPUtime=3.54 cores=1,3,5,7
/proc/681/task/688/stat : 688 (java) S 679 681 510 0 -1 4202560 137161 0 0 0 329 25 0 0 16 0 22 0 607953643 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=689] ppid=679 vsize=15706196 CPUtime=3.49 cores=1,3,5,7
/proc/681/task/689/stat : 689 (java) S 679 681 510 0 -1 4202560 134354 0 0 0 325 24 0 0 15 0 22 0 607953643 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=690] ppid=679 vsize=15706196 CPUtime=3.41 cores=1,3,5,7
/proc/681/task/690/stat : 690 (java) S 679 681 510 0 -1 4202560 134804 0 0 0 317 24 0 0 16 0 22 0 607953643 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=691] ppid=679 vsize=15706196 CPUtime=3.41 cores=1,3,5,7
/proc/681/task/691/stat : 691 (java) S 679 681 510 0 -1 4202560 134884 0 0 0 315 26 0 0 16 0 22 0 607953643 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=692] ppid=679 vsize=15706196 CPUtime=2.36 cores=1,3,5,7
/proc/681/task/692/stat : 692 (java) S 679 681 510 0 -1 4202560 6772 0 0 0 150 86 0 0 15 0 22 0 607953644 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 0 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=693] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/693/stat : 693 (java) S 679 681 510 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=694] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/694/stat : 694 (java) S 679 681 510 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=695] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/695/stat : 695 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216747002289 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=696] ppid=679 vsize=15706196 CPUtime=1.55 cores=1,3,5,7
/proc/681/task/696/stat : 696 (java) S 679 681 510 0 -1 4202560 12801 0 0 0 153 2 0 0 15 0 22 0 607953646 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=697] ppid=679 vsize=15706196 CPUtime=0.79 cores=1,3,5,7
/proc/681/task/697/stat : 697 (java) S 679 681 510 0 -1 4202560 9460 0 0 0 78 1 0 0 15 0 22 0 607953646 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=698] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/698/stat : 698 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=699] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/699/stat : 699 (java) S 679 681 510 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 607953646 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=700] ppid=679 vsize=15706196 CPUtime=1167.74 cores=1,3,5,7
/proc/681/task/700/stat : 700 (java) R 679 681 510 0 -1 4202560 361301 0 0 0 116719 55 0 0 25 0 22 0 607953666 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505830037 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=681/tid=701] ppid=679 vsize=15706196 CPUtime=1166.87 cores=1,3,5,7
/proc/681/task/701/stat : 701 (java) R 679 681 510 0 -1 4202560 356636 0 0 0 116629 58 0 0 25 0 22 0 607953667 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505658744 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=681/tid=702] ppid=679 vsize=15706196 CPUtime=1166.92 cores=1,3,5,7
/proc/681/task/702/stat : 702 (java) R 679 681 510 0 -1 4202560 359721 0 0 0 116640 52 0 0 25 0 22 0 607953667 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912506118826 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=681/tid=703] ppid=679 vsize=15706196 CPUtime=1166.16 cores=1,3,5,7
/proc/681/task/703/stat : 703 (java) R 679 681 510 0 -1 4202560 364097 0 0 0 116563 53 0 0 25 0 22 0 607953667 16083144704 96495 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505806448 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4700.49
Current children cumulated vsize (KiB) 15706196



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.4 s]
/proc/loadavg: 8.11 8.06 8.01 9/220 792
/proc/meminfo: memFree=22520084/32951124 swapFree=67102140/67111528
[pid=681] ppid=679 vsize=15706196 CPUtime=4800.35 cores=1,3,5,7
/proc/681/stat : 681 (java) S 679 681 510 0 -1 4202496 2604614 0 1 0 479508 527 0 0 25 0 22 0 607953641 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746981349 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/681/statm: 3926549 90003 2297 9 0 3917268 0
[pid=681/tid=683] ppid=679 vsize=15706196 CPUtime=0.34 cores=1,3,5,7
/proc/681/task/683/stat : 683 (java) S 679 681 510 0 -1 4202560 6233 0 1 0 32 2 0 0 20 0 22 0 607953642 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=684] ppid=679 vsize=15706196 CPUtime=3.53 cores=1,3,5,7
/proc/681/task/684/stat : 684 (java) S 679 681 510 0 -1 4202560 140945 0 0 0 326 27 0 0 15 0 22 0 607953643 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=685] ppid=679 vsize=15706196 CPUtime=3.55 cores=1,3,5,7
/proc/681/task/685/stat : 685 (java) S 679 681 510 0 -1 4202560 145459 0 0 0 329 26 0 0 15 0 22 0 607953643 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=686] ppid=679 vsize=15706196 CPUtime=3.43 cores=1,3,5,7
/proc/681/task/686/stat : 686 (java) S 679 681 510 0 -1 4202560 130376 0 0 0 316 27 0 0 15 0 22 0 607953643 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=687] ppid=679 vsize=15706196 CPUtime=3.52 cores=1,3,5,7
/proc/681/task/687/stat : 687 (java) S 679 681 510 0 -1 4202560 135076 0 0 0 328 24 0 0 16 0 22 0 607953643 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=688] ppid=679 vsize=15706196 CPUtime=3.61 cores=1,3,5,7
/proc/681/task/688/stat : 688 (java) S 679 681 510 0 -1 4202560 139946 0 0 0 336 25 0 0 15 0 22 0 607953643 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=689] ppid=679 vsize=15706196 CPUtime=3.57 cores=1,3,5,7
/proc/681/task/689/stat : 689 (java) S 679 681 510 0 -1 4202560 137843 0 0 0 332 25 0 0 15 0 22 0 607953643 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=690] ppid=679 vsize=15706196 CPUtime=3.48 cores=1,3,5,7
/proc/681/task/690/stat : 690 (java) S 679 681 510 0 -1 4202560 137963 0 0 0 323 25 0 0 15 0 22 0 607953643 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=691] ppid=679 vsize=15706196 CPUtime=3.48 cores=1,3,5,7
/proc/681/task/691/stat : 691 (java) S 679 681 510 0 -1 4202560 137889 0 0 0 322 26 0 0 15 0 22 0 607953643 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 3 0 0 0
[pid=681/tid=692] ppid=679 vsize=15706196 CPUtime=2.4 cores=1,3,5,7
/proc/681/task/692/stat : 692 (java) S 679 681 510 0 -1 4202560 6865 0 0 0 152 88 0 0 15 0 22 0 607953644 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 0 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=693] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/693/stat : 693 (java) S 679 681 510 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=694] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/694/stat : 694 (java) S 679 681 510 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 607953644 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=695] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/695/stat : 695 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216747002289 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=696] ppid=679 vsize=15706196 CPUtime=1.55 cores=1,3,5,7
/proc/681/task/696/stat : 696 (java) S 679 681 510 0 -1 4202560 12801 0 0 0 153 2 0 0 15 0 22 0 607953646 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 1 0 0 0
[pid=681/tid=697] ppid=679 vsize=15706196 CPUtime=0.79 cores=1,3,5,7
/proc/681/task/697/stat : 697 (java) S 679 681 510 0 -1 4202560 9460 0 0 0 78 1 0 0 15 0 22 0 607953646 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=698] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/698/stat : 698 (java) S 679 681 510 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 607953646 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746994585 0 4 0 16800975 18446604471164294400 0 0 -1 7 0 0 0
[pid=681/tid=699] ppid=679 vsize=15706196 CPUtime=0 cores=1,3,5,7
/proc/681/task/699/stat : 699 (java) S 679 681 510 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 607953646 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 216746995200 0 4 0 16800975 18446604471164294400 0 0 -1 5 0 0 0
[pid=681/tid=700] ppid=679 vsize=15706196 CPUtime=1192.59 cores=1,3,5,7
/proc/681/task/700/stat : 700 (java) R 679 681 510 0 -1 4202560 366330 0 0 0 119203 56 0 0 25 0 22 0 607953666 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505830147 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=681/tid=701] ppid=679 vsize=15706196 CPUtime=1191.71 cores=1,3,5,7
/proc/681/task/701/stat : 701 (java) R 679 681 510 0 -1 4202560 361840 0 0 0 119113 58 0 0 25 0 22 0 607953667 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=681/tid=702] ppid=679 vsize=15706196 CPUtime=1191.72 cores=1,3,5,7
/proc/681/task/702/stat : 702 (java) R 679 681 510 0 -1 4202560 365164 0 0 0 119119 53 0 0 25 0 22 0 607953667 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505869730 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=681/tid=703] ppid=679 vsize=15706196 CPUtime=1190.92 cores=1,3,5,7
/proc/681/task/703/stat : 703 (java) R 679 681 510 0 -1 4202560 368971 0 0 0 119038 54 0 0 25 0 22 0 607953667 16083144704 90003 33554432000 1073741824 1073778376 140733422182000 18446744073709551615 46912505829753 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 15706196

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1207.43
CPU time (s): 4800.41
CPU user time (s): 4795.12
CPU system time (s): 5.29019
CPU usage (%): 397.572
Max. virtual memory (cumulated for all children) (KiB): 15706456

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.12
system time used= 5.29019
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2604641
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 244935
involuntary context switches= 134440

runsolver used 2.09968 second user time and 4.54431 second system time

The end

Launcher Data 

Begin job on node119 at 2011-04-30 17:27:10
IDJOB=3311616
IDBENCH=83001
IDSOLVER=1698
FILE ID=node119/3311616-1304177230
RUNJOBID= node119-1304177102-529
PBS_JOBID= 13172435
Free space on /tmp= 73016 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v500-c2130-S247862791-097.UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311616-1304177230/watcher-3311616-1304177230 -o /tmp/evaluation-result-3311616-1304177230/solver-3311616-1304177230 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311616-1304177230.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6b69f72e1046222baee8c8d817a4adac
RANDOM SEED=492510260

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22845108 kB
Buffers:       1953072 kB
Cached:        6956904 kB
SwapCached:       3688 kB
Active:        1001260 kB
Inactive:      8527692 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22845108 kB
SwapTotal:    67111528 kB
SwapFree:     67102140 kB
Dirty:            1668 kB
Writeback:           0 kB
AnonPages:      618488 kB
Mapped:          23456 kB
Slab:           511964 kB
PageTables:       6656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1010256 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73016 MiB
End job on node119 at 2011-04-30 17:47:19