Trace number 3312028

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.56 1206.64

General information on the benchmark

Nameapplication/fuhs/
AProVE11/AProVE11-15.cnf
MD5SUM518fc0e116993755b5f2dc4ea757b581
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.89771
Satisfiable
(Un)Satisfiability was proved
Number of variables66715
Number of clauses228274
Sum of the clauses size598258
Maximum clause length195
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 293807
Number of clauses of size 3127946
Number of clauses of size 46414
Number of clauses of size 56
Number of clauses of size over 5100

Solver Data 

0.10/0.12	18:29 INFO : Reading from input HOME/instance-3312028-1304097508.cnf
1.23/1.04	Executor set job limit to 1000000
1.23/1.04	Executor set job limit to 1000000
1.23/1.04	Executor set job limit to 1000000
1.23/1.04	Executor set job limit to 1000000
1.23/1.04	Starting Executor!
1.23/1.04	Starting Executor!
1.23/1.04	Starting Executor!
1.23/1.04	Starting Executor!
4.00/2.48	18:31 INFO : Found 23068 xor gates
6.58/4.09	18:33 INFO : 62285 variables remaining out of 66715
6.58/4.09	18:33 INFO : 2357071 literals remaining out of 549716
63.13/20.29	log4j:WARN No appenders could be found for logger (ibis.constellation.impl.SingleThreadedConstellation.CID: 0:2).
63.13/20.29	log4j:WARN Please initialize the log4j system properly.
63.13/20.29	log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312028-1304097508/watcher-3312028-1304097508 -o /tmp/evaluation-result-3312028-1304097508/solver-3312028-1304097508 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312028-1304097508.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.78 7.80 7.92 2/174 19800
/proc/meminfo: memFree=17895388/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=23028 CPUtime=0 cores=1,3,5,7
/proc/19800/stat : 19800 (java) R 19798 19800 19020 0 -1 4202496 827 0 0 0 0 0 0 0 20 0 1 0 521353467 23580672 313 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216629552917 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/19800/statm: 5757 325 255 9 0 124 0

[startup+0.0303871 s]
/proc/loadavg: 6.78 7.80 7.92 2/174 19800
/proc/meminfo: memFree=17895388/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15604116 CPUtime=0.01 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 3492 0 1 0 1 0 0 0 20 0 13 0 521353467 15978614784 2931 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16784584 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3901029 2933 1651 9 0 3891777 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 15604116

[startup+0.100345 s]
/proc/loadavg: 6.78 7.80 7.92 2/174 19800
/proc/meminfo: memFree=17895388/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15741096 CPUtime=0.1 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 5516 0 1 0 9 1 0 0 20 0 18 0 521353467 16118882304 4955 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3935274 4955 2116 9 0 3925993 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15741096

[startup+0.300274 s]
/proc/loadavg: 6.78 7.80 7.92 2/174 19800
/proc/meminfo: memFree=17895388/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15741096 CPUtime=0.52 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 14832 0 1 0 49 3 0 0 20 0 18 0 521353467 16118882304 12913 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3935274 12917 2206 9 0 3925993 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15741096

[startup+0.700253 s]
/proc/loadavg: 6.78 7.80 7.92 2/174 19800
/proc/meminfo: memFree=17895388/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15741096 CPUtime=0.92 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 42054 0 1 0 87 5 0 0 20 0 18 0 521353467 16118882304 40132 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3935274 40132 2222 9 0 3925993 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 15741096

[startup+1.5011 s]
/proc/loadavg: 6.78 7.80 7.92 3/212 19841
/proc/meminfo: memFree=17582236/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15748068 CPUtime=2.14 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 60660 0 1 0 207 7 0 0 20 0 22 0 521353467 16126021632 56771 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3937017 56771 2263 9 0 3927736 0
[pid=19800/tid=19802] ppid=19798 vsize=15748068 CPUtime=1.47 cores=1,3,5,7
/proc/19800/task/19802/stat : 19802 (java) R 19798 19800 19020 0 -1 4202560 42614 0 1 0 142 5 0 0 21 0 22 0 521353468 16126021632 56771 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912505179311 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=19800/tid=19803] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19803/stat : 19803 (java) S 19798 19800 19020 0 -1 4202560 139 0 0 0 0 0 0 0 16 0 22 0 521353469 16126021632 56772 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19804] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19804/stat : 19804 (java) S 19798 19800 19020 0 -1 4202560 414 0 0 0 0 0 0 0 15 0 22 0 521353469 16126021632 56772 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19805] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19805/stat : 19805 (java) S 19798 19800 19020 0 -1 4202560 328 0 0 0 0 0 0 0 16 0 22 0 521353469 16126021632 56772 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19806] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19806/stat : 19806 (java) S 19798 19800 19020 0 -1 4202560 1392 0 0 0 0 0 0 0 16 0 22 0 521353469 16126021632 56772 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19807] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19807/stat : 19807 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 521353469 16126021632 56772 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19808] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19808/stat : 19808 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 521353469 16126021632 56772 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19809] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19809/stat : 19809 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 22 0 521353469 16126021632 56772 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19810] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19810/stat : 19810 (java) S 19798 19800 19020 0 -1 4202560 708 0 0 0 0 0 0 0 15 0 22 0 521353469 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19811] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19811/stat : 19811 (java) S 19798 19800 19020 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 521353470 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 0 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19813] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19813/stat : 19813 (java) S 19798 19800 19020 0 -1 4202560 17 0 0 0 0 0 0 0 19 0 22 0 521353470 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19814] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19814/stat : 19814 (java) S 19798 19800 19020 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 22 0 521353470 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19829] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19829/stat : 19829 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 521353472 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646338993 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19830] ppid=19798 vsize=15748068 CPUtime=0.44 cores=1,3,5,7
/proc/19800/task/19830/stat : 19830 (java) R 19798 19800 19020 0 -1 4202560 10807 0 0 0 43 1 0 0 16 0 22 0 521353472 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46983662004388 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=19800/tid=19831] ppid=19798 vsize=15748068 CPUtime=0.2 cores=1,3,5,7
/proc/19800/task/19831/stat : 19831 (java) S 19798 19800 19020 0 -1 4202560 2758 0 0 0 20 0 0 0 15 0 22 0 521353472 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19832] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19832/stat : 19832 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 521353472 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19833] ppid=19798 vsize=15748068 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19833/stat : 19833 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 521353472 16126021632 56773 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.14
Current children cumulated vsize (KiB) 15748068

[startup+3.10083 s]
/proc/loadavg: 6.78 7.80 7.92 5/220 19849
/proc/meminfo: memFree=17452632/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15745340 CPUtime=5.17 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 82634 0 1 0 507 10 0 0 20 0 22 0 521353467 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3936335 70227 2266 9 0 3927054 0
[pid=19800/tid=19802] ppid=19798 vsize=15745340 CPUtime=3.06 cores=1,3,5,7
/proc/19800/task/19802/stat : 19802 (java) R 19798 19800 19020 0 -1 4202560 55160 0 1 0 300 6 0 0 18 0 22 0 521353468 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506283217 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=19800/tid=19803] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19803/stat : 19803 (java) S 19798 19800 19020 0 -1 4202560 139 0 0 0 0 0 0 0 16 0 22 0 521353469 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19804] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19804/stat : 19804 (java) S 19798 19800 19020 0 -1 4202560 414 0 0 0 0 0 0 0 15 0 22 0 521353469 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19805] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19805/stat : 19805 (java) S 19798 19800 19020 0 -1 4202560 328 0 0 0 0 0 0 0 16 0 22 0 521353469 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19806] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19806/stat : 19806 (java) S 19798 19800 19020 0 -1 4202560 1392 0 0 0 0 0 0 0 16 0 22 0 521353469 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19807] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19807/stat : 19807 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 521353469 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19808] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19808/stat : 19808 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 521353469 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19809] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19809/stat : 19809 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 22 0 521353469 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19810] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19810/stat : 19810 (java) S 19798 19800 19020 0 -1 4202560 708 0 0 0 0 0 0 0 15 0 22 0 521353469 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19811] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19811/stat : 19811 (java) S 19798 19800 19020 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 521353470 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 0 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19813] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19813/stat : 19813 (java) S 19798 19800 19020 0 -1 4202560 17 0 0 0 0 0 0 0 19 0 22 0 521353470 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19814] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19814/stat : 19814 (java) S 19798 19800 19020 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 22 0 521353470 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19829] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19829/stat : 19829 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 521353472 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646338993 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19830] ppid=19798 vsize=15745340 CPUtime=1.15 cores=1,3,5,7
/proc/19800/task/19830/stat : 19830 (java) S 19798 19800 19020 0 -1 4202560 16544 0 0 0 113 2 0 0 15 0 22 0 521353472 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19831] ppid=19798 vsize=15745340 CPUtime=0.91 cores=1,3,5,7
/proc/19800/task/19831/stat : 19831 (java) S 19798 19800 19020 0 -1 4202560 6446 0 0 0 91 0 0 0 15 0 22 0 521353472 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19832] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19832/stat : 19832 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 521353472 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19833] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19833/stat : 19833 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 521353472 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19842] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19842/stat : 19842 (java) S 19798 19800 19020 0 -1 4202560 14 0 0 0 0 0 0 0 15 0 22 0 521353572 16123228160 70227 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19843] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19843/stat : 19843 (java) S 19798 19800 19020 0 -1 4202560 13 0 0 0 0 0 0 0 15 0 22 0 521353572 16123228160 70228 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19844] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19844/stat : 19844 (java) S 19798 19800 19020 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 22 0 521353572 16123228160 70228 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19845] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19845/stat : 19845 (java) S 19798 19800 19020 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 521353572 16123228160 70228 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.17
Current children cumulated vsize (KiB) 15745340

[startup+6.30126 s]
/proc/loadavg: 6.63 7.75 7.91 5/220 19849
/proc/meminfo: memFree=17098028/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15745340 CPUtime=11.37 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 137262 0 1 0 1120 17 0 0 20 0 22 0 521353467 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3936335 123107 2286 9 0 3927054 0
[pid=19800/tid=19802] ppid=19798 vsize=15745340 CPUtime=4.05 cores=1,3,5,7
/proc/19800/task/19802/stat : 19802 (java) S 19798 19800 19020 0 -1 4202560 66330 0 1 0 398 7 0 0 19 0 22 0 521353468 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19803] ppid=19798 vsize=15745340 CPUtime=0.06 cores=1,3,5,7
/proc/19800/task/19803/stat : 19803 (java) S 19798 19800 19020 0 -1 4202560 10706 0 0 0 5 1 0 0 16 0 22 0 521353469 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19804] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19804/stat : 19804 (java) S 19798 19800 19020 0 -1 4202560 414 0 0 0 0 0 0 0 15 0 22 0 521353469 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19805] ppid=19798 vsize=15745340 CPUtime=0.06 cores=1,3,5,7
/proc/19800/task/19805/stat : 19805 (java) S 19798 19800 19020 0 -1 4202560 12195 0 0 0 5 1 0 0 16 0 22 0 521353469 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19806] ppid=19798 vsize=15745340 CPUtime=0.06 cores=1,3,5,7
/proc/19800/task/19806/stat : 19806 (java) S 19798 19800 19020 0 -1 4202560 10270 0 0 0 5 1 0 0 16 0 22 0 521353469 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19807] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19807/stat : 19807 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 521353469 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19808] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19808/stat : 19808 (java) S 19798 19800 19020 0 -1 4202560 520 0 0 0 0 0 0 0 16 0 22 0 521353469 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19809] ppid=19798 vsize=15745340 CPUtime=0.05 cores=1,3,5,7
/proc/19800/task/19809/stat : 19809 (java) S 19798 19800 19020 0 -1 4202560 11321 0 0 0 4 1 0 0 16 0 22 0 521353469 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19810] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19810/stat : 19810 (java) S 19798 19800 19020 0 -1 4202560 708 0 0 0 0 0 0 0 15 0 22 0 521353469 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19811] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19811/stat : 19811 (java) S 19798 19800 19020 0 -1 4202560 271 0 0 0 0 0 0 0 16 0 22 0 521353470 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 0 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19813] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19813/stat : 19813 (java) S 19798 19800 19020 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 521353470 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19814] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19814/stat : 19814 (java) S 19798 19800 19020 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 521353470 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19829] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19829/stat : 19829 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 521353472 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646338993 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19830] ppid=19798 vsize=15745340 CPUtime=1.76 cores=1,3,5,7
/proc/19800/task/19830/stat : 19830 (java) S 19798 19800 19020 0 -1 4202560 16605 0 0 0 174 2 0 0 16 0 22 0 521353472 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19831] ppid=19798 vsize=15745340 CPUtime=1.23 cores=1,3,5,7
/proc/19800/task/19831/stat : 19831 (java) S 19798 19800 19020 0 -1 4202560 6467 0 0 0 123 0 0 0 15 0 22 0 521353472 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19832] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19832/stat : 19832 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 521353472 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19833] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19833/stat : 19833 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 521353472 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19842] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19842/stat : 19842 (java) S 19798 19800 19020 0 -1 4202560 16 0 0 0 0 0 0 0 15 0 22 0 521353572 16123228160 123107 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0

################
# More data... #
################

/proc/meminfo: memFree=6058816/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15745340 CPUtime=4464.39 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 1740976 0 1 0 446189 250 0 0 20 0 22 0 521353467 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3936335 1480921 2299 9 0 3927054 0
[pid=19800/tid=19802] ppid=19798 vsize=15745340 CPUtime=4.05 cores=1,3,5,7
/proc/19800/task/19802/stat : 19802 (java) S 19798 19800 19020 0 -1 4202560 66330 0 1 0 398 7 0 0 19 0 22 0 521353468 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19803] ppid=19798 vsize=15745340 CPUtime=1.96 cores=1,3,5,7
/proc/19800/task/19803/stat : 19803 (java) S 19798 19800 19020 0 -1 4202560 143953 0 0 0 175 21 0 0 16 0 22 0 521353469 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19804] ppid=19798 vsize=15745340 CPUtime=1.7 cores=1,3,5,7
/proc/19800/task/19804/stat : 19804 (java) S 19798 19800 19020 0 -1 4202560 132909 0 0 0 151 19 0 0 16 0 22 0 521353469 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19805] ppid=19798 vsize=15745340 CPUtime=1.62 cores=1,3,5,7
/proc/19800/task/19805/stat : 19805 (java) S 19798 19800 19020 0 -1 4202560 127314 0 0 0 143 19 0 0 16 0 22 0 521353469 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19806] ppid=19798 vsize=15745340 CPUtime=1.73 cores=1,3,5,7
/proc/19800/task/19806/stat : 19806 (java) S 19798 19800 19020 0 -1 4202560 128607 0 0 0 153 20 0 0 15 0 22 0 521353469 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19807] ppid=19798 vsize=15745340 CPUtime=1.47 cores=1,3,5,7
/proc/19800/task/19807/stat : 19807 (java) S 19798 19800 19020 0 -1 4202560 99040 0 0 0 132 15 0 0 15 0 22 0 521353469 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19808] ppid=19798 vsize=15745340 CPUtime=1.97 cores=1,3,5,7
/proc/19800/task/19808/stat : 19808 (java) S 19798 19800 19020 0 -1 4202560 150615 0 0 0 175 22 0 0 15 0 22 0 521353469 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19809] ppid=19798 vsize=15745340 CPUtime=1.96 cores=1,3,5,7
/proc/19800/task/19809/stat : 19809 (java) S 19798 19800 19020 0 -1 4202560 184813 0 0 0 166 30 0 0 16 0 22 0 521353469 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19810] ppid=19798 vsize=15745340 CPUtime=1.73 cores=1,3,5,7
/proc/19800/task/19810/stat : 19810 (java) S 19798 19800 19020 0 -1 4202560 140245 0 0 0 151 22 0 0 15 0 22 0 521353469 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19811] ppid=19798 vsize=15745340 CPUtime=0.64 cores=1,3,5,7
/proc/19800/task/19811/stat : 19811 (java) S 19798 19800 19020 0 -1 4202560 9357 0 0 0 60 4 0 0 15 0 22 0 521353470 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 0 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19813] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19813/stat : 19813 (java) S 19798 19800 19020 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 521353470 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19814] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19814/stat : 19814 (java) S 19798 19800 19020 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 521353470 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19829] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19829/stat : 19829 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 521353472 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646338993 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19830] ppid=19798 vsize=15745340 CPUtime=2.29 cores=1,3,5,7
/proc/19800/task/19830/stat : 19830 (java) S 19798 19800 19020 0 -1 4202560 16628 0 0 0 227 2 0 0 16 0 22 0 521353472 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19831] ppid=19798 vsize=15745340 CPUtime=1.59 cores=1,3,5,7
/proc/19800/task/19831/stat : 19831 (java) S 19798 19800 19020 0 -1 4202560 6480 0 0 0 159 0 0 0 16 0 22 0 521353472 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19832] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19832/stat : 19832 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 521353472 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19833] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19833/stat : 19833 (java) S 19798 19800 19020 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 521353472 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19842] ppid=19798 vsize=15745340 CPUtime=1110.87 cores=1,3,5,7
/proc/19800/task/19842/stat : 19842 (java) R 19798 19800 19020 0 -1 4202560 150236 0 0 0 111069 18 0 0 25 0 22 0 521353572 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506282848 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=19800/tid=19843] ppid=19798 vsize=15745340 CPUtime=1110.9 cores=1,3,5,7
/proc/19800/task/19843/stat : 19843 (java) R 19798 19800 19020 0 -1 4202560 129384 0 0 0 111077 13 0 0 25 0 22 0 521353572 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912505797322 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=19800/tid=19844] ppid=19798 vsize=15745340 CPUtime=1108.27 cores=1,3,5,7
/proc/19800/task/19844/stat : 19844 (java) R 19798 19800 19020 0 -1 4202560 149233 0 0 0 110811 16 0 0 25 0 22 0 521353572 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506622309 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=19800/tid=19845] ppid=19798 vsize=15745340 CPUtime=1111.44 cores=1,3,5,7
/proc/19800/task/19845/stat : 19845 (java) R 19798 19800 19020 0 -1 4202560 104380 0 0 0 111133 11 0 0 25 0 22 0 521353572 16123228160 1480921 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506282895 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4464.39
Current children cumulated vsize (KiB) 15745340

[startup+1182.3 s]
/proc/loadavg: 8.10 8.07 8.01 9/220 19881
/proc/meminfo: memFree=6044140/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15745340 CPUtime=4704.02 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 1745036 0 1 0 470151 251 0 0 20 0 22 0 521353467 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3936335 1484485 2299 9 0 3927054 0
[pid=19800/tid=19802] ppid=19798 vsize=15745340 CPUtime=4.05 cores=1,3,5,7
/proc/19800/task/19802/stat : 19802 (java) S 19798 19800 19020 0 -1 4202560 66330 0 1 0 398 7 0 0 19 0 22 0 521353468 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19803] ppid=19798 vsize=15745340 CPUtime=2.04 cores=1,3,5,7
/proc/19800/task/19803/stat : 19803 (java) S 19798 19800 19020 0 -1 4202560 143999 0 0 0 183 21 0 0 15 0 22 0 521353469 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19804] ppid=19798 vsize=15745340 CPUtime=1.8 cores=1,3,5,7
/proc/19800/task/19804/stat : 19804 (java) S 19798 19800 19020 0 -1 4202560 132935 0 0 0 161 19 0 0 15 0 22 0 521353469 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19805] ppid=19798 vsize=15745340 CPUtime=1.68 cores=1,3,5,7
/proc/19800/task/19805/stat : 19805 (java) S 19798 19800 19020 0 -1 4202560 128149 0 0 0 148 20 0 0 16 0 22 0 521353469 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19806] ppid=19798 vsize=15745340 CPUtime=1.78 cores=1,3,5,7
/proc/19800/task/19806/stat : 19806 (java) S 19798 19800 19020 0 -1 4202560 128607 0 0 0 158 20 0 0 15 0 22 0 521353469 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19807] ppid=19798 vsize=15745340 CPUtime=1.53 cores=1,3,5,7
/proc/19800/task/19807/stat : 19807 (java) S 19798 19800 19020 0 -1 4202560 99076 0 0 0 138 15 0 0 16 0 22 0 521353469 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19808] ppid=19798 vsize=15745340 CPUtime=2.04 cores=1,3,5,7
/proc/19800/task/19808/stat : 19808 (java) S 19798 19800 19020 0 -1 4202560 153026 0 0 0 182 22 0 0 16 0 22 0 521353469 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19809] ppid=19798 vsize=15745340 CPUtime=2.01 cores=1,3,5,7
/proc/19800/task/19809/stat : 19809 (java) S 19798 19800 19020 0 -1 4202560 184988 0 0 0 171 30 0 0 15 0 22 0 521353469 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19810] ppid=19798 vsize=15745340 CPUtime=1.8 cores=1,3,5,7
/proc/19800/task/19810/stat : 19810 (java) S 19798 19800 19020 0 -1 4202560 140754 0 0 0 158 22 0 0 16 0 22 0 521353469 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19811] ppid=19798 vsize=15745340 CPUtime=0.65 cores=1,3,5,7
/proc/19800/task/19811/stat : 19811 (java) S 19798 19800 19020 0 -1 4202560 9364 0 0 0 61 4 0 0 15 0 22 0 521353470 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 0 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19813] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19813/stat : 19813 (java) S 19798 19800 19020 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 521353470 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19814] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19814/stat : 19814 (java) S 19798 19800 19020 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 521353470 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19829] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19829/stat : 19829 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 521353472 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646338993 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19830] ppid=19798 vsize=15745340 CPUtime=2.29 cores=1,3,5,7
/proc/19800/task/19830/stat : 19830 (java) S 19798 19800 19020 0 -1 4202560 16628 0 0 0 227 2 0 0 16 0 22 0 521353472 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19831] ppid=19798 vsize=15745340 CPUtime=1.59 cores=1,3,5,7
/proc/19800/task/19831/stat : 19831 (java) S 19798 19800 19020 0 -1 4202560 6480 0 0 0 159 0 0 0 16 0 22 0 521353472 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19832] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19832/stat : 19832 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 521353472 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19833] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19833/stat : 19833 (java) S 19798 19800 19020 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 521353472 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19842] ppid=19798 vsize=15745340 CPUtime=1170.55 cores=1,3,5,7
/proc/19800/task/19842/stat : 19842 (java) R 19798 19800 19020 0 -1 4202560 150240 0 0 0 117037 18 0 0 25 0 22 0 521353572 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506271808 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=19800/tid=19843] ppid=19798 vsize=15745340 CPUtime=1170.6 cores=1,3,5,7
/proc/19800/task/19843/stat : 19843 (java) R 19798 19800 19020 0 -1 4202560 129387 0 0 0 117047 13 0 0 25 0 22 0 521353572 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506246466 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=19800/tid=19844] ppid=19798 vsize=15745340 CPUtime=1168.12 cores=1,3,5,7
/proc/19800/task/19844/stat : 19844 (java) R 19798 19800 19020 0 -1 4202560 149233 0 0 0 116796 16 0 0 25 0 22 0 521353572 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506479301 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=19800/tid=19845] ppid=19798 vsize=15745340 CPUtime=1171.29 cores=1,3,5,7
/proc/19800/task/19845/stat : 19845 (java) R 19798 19800 19020 0 -1 4202560 104384 0 0 0 117118 11 0 0 25 0 22 0 521353572 16123228160 1484485 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 18446744073699065961 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4704.02
Current children cumulated vsize (KiB) 15745340



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.4 s]
/proc/loadavg: 8.14 8.08 8.01 9/220 19881
/proc/meminfo: memFree=6040164/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=15745340 CPUtime=4800.3 cores=1,3,5,7
/proc/19800/stat : 19800 (java) S 19798 19800 19020 0 -1 4202496 1746120 0 1 0 479778 252 0 0 20 0 22 0 521353467 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646318053 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 3936335 1485561 2299 9 0 3927054 0
[pid=19800/tid=19802] ppid=19798 vsize=15745340 CPUtime=4.05 cores=1,3,5,7
/proc/19800/task/19802/stat : 19802 (java) S 19798 19800 19020 0 -1 4202560 66330 0 1 0 398 7 0 0 19 0 22 0 521353468 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19803] ppid=19798 vsize=15745340 CPUtime=2.07 cores=1,3,5,7
/proc/19800/task/19803/stat : 19803 (java) S 19798 19800 19020 0 -1 4202560 143999 0 0 0 186 21 0 0 16 0 22 0 521353469 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19804] ppid=19798 vsize=15745340 CPUtime=1.84 cores=1,3,5,7
/proc/19800/task/19804/stat : 19804 (java) S 19798 19800 19020 0 -1 4202560 133525 0 0 0 165 19 0 0 16 0 22 0 521353469 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19805] ppid=19798 vsize=15745340 CPUtime=1.69 cores=1,3,5,7
/proc/19800/task/19805/stat : 19805 (java) S 19798 19800 19020 0 -1 4202560 128150 0 0 0 149 20 0 0 15 0 22 0 521353469 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19806] ppid=19798 vsize=15745340 CPUtime=1.8 cores=1,3,5,7
/proc/19800/task/19806/stat : 19806 (java) S 19798 19800 19020 0 -1 4202560 128607 0 0 0 160 20 0 0 16 0 22 0 521353469 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19807] ppid=19798 vsize=15745340 CPUtime=1.56 cores=1,3,5,7
/proc/19800/task/19807/stat : 19807 (java) S 19798 19800 19020 0 -1 4202560 99531 0 0 0 141 15 0 0 15 0 22 0 521353469 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19808] ppid=19798 vsize=15745340 CPUtime=2.07 cores=1,3,5,7
/proc/19800/task/19808/stat : 19808 (java) S 19798 19800 19020 0 -1 4202560 153051 0 0 0 185 22 0 0 15 0 22 0 521353469 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19809] ppid=19798 vsize=15745340 CPUtime=2.02 cores=1,3,5,7
/proc/19800/task/19809/stat : 19809 (java) S 19798 19800 19020 0 -1 4202560 184988 0 0 0 172 30 0 0 15 0 22 0 521353469 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19810] ppid=19798 vsize=15745340 CPUtime=1.84 cores=1,3,5,7
/proc/19800/task/19810/stat : 19810 (java) S 19798 19800 19020 0 -1 4202560 140759 0 0 0 162 22 0 0 16 0 22 0 521353469 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19811] ppid=19798 vsize=15745340 CPUtime=0.65 cores=1,3,5,7
/proc/19800/task/19811/stat : 19811 (java) S 19798 19800 19020 0 -1 4202560 9366 0 0 0 61 4 0 0 15 0 22 0 521353470 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 0 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19813] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19813/stat : 19813 (java) S 19798 19800 19020 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 521353470 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19814] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19814/stat : 19814 (java) S 19798 19800 19020 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 521353470 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19829] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19829/stat : 19829 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 521353472 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646338993 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19830] ppid=19798 vsize=15745340 CPUtime=2.29 cores=1,3,5,7
/proc/19800/task/19830/stat : 19830 (java) S 19798 19800 19020 0 -1 4202560 16628 0 0 0 227 2 0 0 16 0 22 0 521353472 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 1 0 0 0
[pid=19800/tid=19831] ppid=19798 vsize=15745340 CPUtime=1.59 cores=1,3,5,7
/proc/19800/task/19831/stat : 19831 (java) S 19798 19800 19020 0 -1 4202560 6480 0 0 0 159 0 0 0 16 0 22 0 521353472 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 7 0 0 0
[pid=19800/tid=19832] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19832/stat : 19832 (java) S 19798 19800 19020 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 521353472 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331289 0 4 0 16800975 18446604471112489920 0 0 -1 5 0 0 0
[pid=19800/tid=19833] ppid=19798 vsize=15745340 CPUtime=0 cores=1,3,5,7
/proc/19800/task/19833/stat : 19833 (java) S 19798 19800 19020 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 521353472 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 216646331904 0 4 0 16800975 18446604471112489920 0 0 -1 3 0 0 0
[pid=19800/tid=19842] ppid=19798 vsize=15745340 CPUtime=1194.46 cores=1,3,5,7
/proc/19800/task/19842/stat : 19842 (java) R 19798 19800 19020 0 -1 4202560 150241 0 0 0 119428 18 0 0 25 0 22 0 521353572 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912505601576 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=19800/tid=19843] ppid=19798 vsize=15745340 CPUtime=1194.65 cores=1,3,5,7
/proc/19800/task/19843/stat : 19843 (java) R 19798 19800 19020 0 -1 4202560 129389 0 0 0 119452 13 0 0 25 0 22 0 521353572 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506271467 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=19800/tid=19844] ppid=19798 vsize=15745340 CPUtime=1192.17 cores=1,3,5,7
/proc/19800/task/19844/stat : 19844 (java) R 19798 19800 19020 0 -1 4202560 149234 0 0 0 119201 16 0 0 25 0 22 0 521353572 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912506611072 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=19800/tid=19845] ppid=19798 vsize=15745340 CPUtime=1195.34 cores=1,3,5,7
/proc/19800/task/19845/stat : 19845 (java) R 19798 19800 19020 0 -1 4202560 104384 0 0 0 119523 11 0 0 25 0 22 0 521353572 16123228160 1485561 33554432000 1073741824 1073778376 140736197691344 18446744073709551615 46912505630560 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 15745340

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1206.6 s]
/proc/loadavg: 8.14 8.08 8.01 6/201 19884
/proc/meminfo: memFree=10896900/32951124 swapFree=67111528/67111528
[pid=19800] ppid=19798 vsize=0 CPUtime=4800.52 cores=1,3,5,7
/proc/19800/stat : 19800 (java) Z 19798 19800 19020 0 -1 4203548 1746146 0 1 0 479781 271 0 0 17 0 2 0 521353467 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/19800/statm: 0 0 0 0 0 0 0
[pid=19800/tid=19845] ppid=19798 vsize=0 CPUtime=1195.54 cores=1,3,5,7
/proc/19800/task/19845/stat : 19845 (java) R 19798 19800 19020 0 -1 4203588 104384 0 0 0 119523 31 0 0 25 0 2 0 521353572 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.52
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1206.64
CPU time (s): 4800.56
CPU user time (s): 4797.81
CPU system time (s): 2.74458
CPU usage (%): 397.845
Max. virtual memory (cumulated for all children) (KiB): 15748164

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.81
system time used= 2.74458
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1746146
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 33172
involuntary context switches= 48784

runsolver used 2.03969 second user time and 4.5823 second system time

The end

Launcher Data 

Begin job on node103 at 2011-04-29 19:18:29
IDJOB=3312028
IDBENCH=82345
IDSOLVER=1698
FILE ID=node103/3312028-1304097508
RUNJOBID= node103-1304097508-19787
PBS_JOBID= 13170574
Free space on /tmp= 71512 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/application/fuhs/AProVE11/AProVE11-15.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312028-1304097508/watcher-3312028-1304097508 -o /tmp/evaluation-result-3312028-1304097508/solver-3312028-1304097508 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312028-1304097508.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 518fc0e116993755b5f2dc4ea757b581
RANDOM SEED=534329685

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17895668 kB
Buffers:       2148812 kB
Cached:       12256108 kB
SwapCached:          0 kB
Active:        5589348 kB
Inactive:      8883128 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17895668 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            9808 kB
Writeback:           0 kB
AnonPages:       67052 kB
Mapped:          14480 kB
Slab:           519932 kB
PageTables:       4728 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   190792 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71504 MiB
End job on node103 at 2011-04-29 19:38:37