Trace number 3311292

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.22 1203.13

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v5000-c21000-S1781430408-009-UNKNOWN.cnf
MD5SUM64eaf16e48e921b573c32a7e8a6347cd
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.56261
Satisfiable
(Un)Satisfiability was proved
Number of variables5000
Number of clauses21000
Sum of the clauses size63000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 321000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.12	06:49 INFO : Reading from input HOME/instance-3311292-1304118409.cnf
0.52/0.37	Executor set job limit to 1000000
0.52/0.37	Executor set job limit to 1000000
0.52/0.37	Executor set job limit to 1000000
0.52/0.37	Executor set job limit to 1000000
0.52/0.37	Starting Executor!
0.52/0.37	Starting Executor!
0.52/0.37	Starting Executor!
0.52/0.37	Starting Executor!
2.00/0.98	06:50 INFO : 4981 variables remaining out of 5000
2.00/0.98	06:50 INFO : 83460 literals remaining out of 84000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311292-1304118409/watcher-3311292-1304118409 -o /tmp/evaluation-result-3311292-1304118409/solver-3311292-1304118409 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311292-1304118409.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.81 5.45 6.86 2/174 23785
/proc/meminfo: memFree=30810048/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=23028 CPUtime=0 cores=0,2,4,6
/proc/23785/stat : 23785 (java) R 23783 23785 23457 0 -1 4202496 1043 0 0 0 0 0 0 0 25 0 1 0 602071513 23580672 530 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260015433493 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23785/statm: 5757 541 410 9 0 124 0

[startup+0.0739141 s]
/proc/loadavg: 3.81 5.45 6.86 2/174 23785
/proc/meminfo: memFree=30810048/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15609780 CPUtime=0.06 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 4400 0 1 0 6 0 0 0 25 0 18 0 602071513 15984414720 3839 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3902445 3839 1779 9 0 3893164 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 15609780

[startup+0.104258 s]
/proc/loadavg: 3.81 5.45 6.86 2/174 23785
/proc/meminfo: memFree=30810048/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15676680 CPUtime=0.1 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 5565 0 1 0 9 1 0 0 25 0 18 0 602071513 16052920320 4982 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3919170 4982 2116 9 0 3909889 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676680

[startup+0.300804 s]
/proc/loadavg: 3.81 5.45 6.86 2/174 23785
/proc/meminfo: memFree=30810048/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15682528 CPUtime=0.52 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 14269 0 1 0 50 2 0 0 25 0 18 0 602071513 16058908672 12535 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3920632 12538 2205 9 0 3911351 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15682528

[startup+0.700766 s]
/proc/loadavg: 3.81 5.45 6.86 2/174 23785
/proc/meminfo: memFree=30810048/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15700692 CPUtime=1.41 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 33649 0 1 0 136 5 0 0 25 0 22 0 602071513 16077508608 29803 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3925173 29803 2249 9 0 3915892 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 15700692

[startup+1.50156 s]
/proc/loadavg: 3.81 5.45 6.86 5/220 23834
/proc/meminfo: memFree=30497908/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15706172 CPUtime=3.81 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 63419 0 1 0 372 9 0 0 25 0 22 0 602071513 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3926543 53983 2275 9 0 3917262 0
[pid=23785/tid=23787] ppid=23783 vsize=15706172 CPUtime=0.96 cores=0,2,4,6
/proc/23785/task/23787/stat : 23787 (java) S 23783 23785 23457 0 -1 4202560 22070 0 1 0 93 3 0 0 18 0 22 0 602071514 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23788] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23788/stat : 23788 (java) S 23783 23785 23457 0 -1 4202560 1051 0 0 0 0 0 0 0 16 0 22 0 602071515 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23789] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23789/stat : 23789 (java) S 23783 23785 23457 0 -1 4202560 1266 0 0 0 0 0 0 0 16 0 22 0 602071515 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23790] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23790/stat : 23790 (java) S 23783 23785 23457 0 -1 4202560 2000 0 0 0 0 0 0 0 16 0 22 0 602071515 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23791] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23791/stat : 23791 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 22 0 602071515 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23792] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23792/stat : 23792 (java) S 23783 23785 23457 0 -1 4202560 3 0 0 0 0 0 0 0 16 0 22 0 602071515 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23793] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23793/stat : 23793 (java) S 23783 23785 23457 0 -1 4202560 882 0 0 0 0 0 0 0 16 0 22 0 602071515 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23794] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23794/stat : 23794 (java) S 23783 23785 23457 0 -1 4202560 803 0 0 0 0 0 0 0 16 0 22 0 602071515 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23795] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23795/stat : 23795 (java) S 23783 23785 23457 0 -1 4202560 585 0 0 0 0 0 0 0 16 0 22 0 602071515 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23797] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23797/stat : 23797 (java) S 23783 23785 23457 0 -1 4202560 74 0 0 0 0 0 0 0 15 0 22 0 602071516 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 0 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23802] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23802/stat : 23802 (java) S 23783 23785 23457 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602071516 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23803] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23803/stat : 23803 (java) S 23783 23785 23457 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 602071516 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23815] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23815/stat : 23815 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 602071518 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032219569 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23816] ppid=23783 vsize=15706172 CPUtime=1 cores=0,2,4,6
/proc/23785/task/23816/stat : 23816 (java) R 23783 23785 23457 0 -1 4202560 12194 0 0 0 99 1 0 0 23 0 22 0 602071518 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23785/tid=23817] ppid=23783 vsize=15706172 CPUtime=0.83 cores=0,2,4,6
/proc/23785/task/23817/stat : 23817 (java) S 23783 23785 23457 0 -1 4202560 7465 0 0 0 81 2 0 0 15 0 22 0 602071519 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23818] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23818/stat : 23818 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 602071519 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23819] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23819/stat : 23819 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 602071519 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23827] ppid=23783 vsize=15706172 CPUtime=0.11 cores=0,2,4,6
/proc/23785/task/23827/stat : 23827 (java) R 23783 23785 23457 0 -1 4202560 2267 0 0 0 11 0 0 0 16 0 22 0 602071551 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912505924008 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23785/tid=23828] ppid=23783 vsize=15706172 CPUtime=0.43 cores=0,2,4,6
/proc/23785/task/23828/stat : 23828 (java) R 23783 23785 23457 0 -1 4202560 6284 0 0 0 43 0 0 0 16 0 22 0 602071551 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 18446744073699066094 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23785/tid=23829] ppid=23783 vsize=15706172 CPUtime=0.27 cores=0,2,4,6
/proc/23785/task/23829/stat : 23829 (java) R 23783 23785 23457 0 -1 4202560 5068 0 0 0 27 0 0 0 16 0 22 0 602071551 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912505909169 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23785/tid=23830] ppid=23783 vsize=15706172 CPUtime=0.13 cores=0,2,4,6
/proc/23785/task/23830/stat : 23830 (java) R 23783 23785 23457 0 -1 4202560 21 0 0 0 13 0 0 0 16 0 22 0 602071551 16083120128 53983 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912505999330 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.81
Current children cumulated vsize (KiB) 15706172

[startup+3.11264 s]
/proc/loadavg: 4.23 5.51 6.87 11/220 23834
/proc/meminfo: memFree=30251768/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15706172 CPUtime=10.22 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 199688 0 1 0 993 29 0 0 25 0 22 0 602071513 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3926543 189854 2275 9 0 3917262 0
[pid=23785/tid=23787] ppid=23783 vsize=15706172 CPUtime=0.96 cores=0,2,4,6
/proc/23785/task/23787/stat : 23787 (java) S 23783 23785 23457 0 -1 4202560 22070 0 1 0 93 3 0 0 18 0 22 0 602071514 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23788] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23788/stat : 23788 (java) R 23783 23785 23457 0 -1 4202560 1051 0 0 0 0 0 0 0 15 0 22 0 602071515 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23785/tid=23789] ppid=23783 vsize=15706172 CPUtime=0.03 cores=0,2,4,6
/proc/23785/task/23789/stat : 23789 (java) R 23783 23785 23457 0 -1 4202560 12292 0 0 0 2 1 0 0 15 0 22 0 602071515 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260020349239 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23785/tid=23790] ppid=23783 vsize=15706172 CPUtime=0.01 cores=0,2,4,6
/proc/23785/task/23790/stat : 23790 (java) S 23783 23785 23457 0 -1 4202560 5333 0 0 0 1 0 0 0 15 0 22 0 602071515 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23791] ppid=23783 vsize=15706172 CPUtime=0.04 cores=0,2,4,6
/proc/23785/task/23791/stat : 23791 (java) R 23783 23785 23457 0 -1 4202560 10809 0 0 0 3 1 0 0 15 0 22 0 602071515 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260020349239 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=23785/tid=23792] ppid=23783 vsize=15706172 CPUtime=0.05 cores=0,2,4,6
/proc/23785/task/23792/stat : 23792 (java) R 23783 23785 23457 0 -1 4202560 13406 0 0 0 4 1 0 0 15 0 22 0 602071515 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260020349239 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23785/tid=23793] ppid=23783 vsize=15706172 CPUtime=0.03 cores=0,2,4,6
/proc/23785/task/23793/stat : 23793 (java) R 23783 23785 23457 0 -1 4202560 8147 0 0 0 2 1 0 0 15 0 22 0 602071515 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260020349239 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23785/tid=23794] ppid=23783 vsize=15706172 CPUtime=0.06 cores=0,2,4,6
/proc/23785/task/23794/stat : 23794 (java) R 23783 23785 23457 0 -1 4202560 15413 0 0 0 4 2 0 0 15 0 22 0 602071515 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260020349239 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23785/tid=23795] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23795/stat : 23795 (java) S 23783 23785 23457 0 -1 4202560 3044 0 0 0 0 0 0 0 15 0 22 0 602071515 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23797] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23797/stat : 23797 (java) S 23783 23785 23457 0 -1 4202560 243 0 0 0 0 0 0 0 15 0 22 0 602071516 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 0 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23802] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23802/stat : 23802 (java) S 23783 23785 23457 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602071516 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23803] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23803/stat : 23803 (java) S 23783 23785 23457 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 602071516 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23815] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23815/stat : 23815 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 602071518 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032219569 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23816] ppid=23783 vsize=15706172 CPUtime=1 cores=0,2,4,6
/proc/23785/task/23816/stat : 23816 (java) S 23783 23785 23457 0 -1 4202560 12195 0 0 0 99 1 0 0 18 0 22 0 602071518 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23817] ppid=23783 vsize=15706172 CPUtime=0.91 cores=0,2,4,6
/proc/23785/task/23817/stat : 23817 (java) S 23783 23785 23457 0 -1 4202560 7702 0 0 0 89 2 0 0 15 0 22 0 602071519 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23818] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23818/stat : 23818 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 602071519 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23819] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23819/stat : 23819 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 602071519 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23827] ppid=23783 vsize=15706172 CPUtime=1.59 cores=0,2,4,6
/proc/23785/task/23827/stat : 23827 (java) S 23783 23785 23457 0 -1 4202560 20264 0 0 0 157 2 0 0 17 0 22 0 602071551 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23828] ppid=23783 vsize=15706172 CPUtime=1.97 cores=0,2,4,6
/proc/23785/task/23828/stat : 23828 (java) S 23783 23785 23457 0 -1 4202560 24830 0 0 0 194 3 0 0 17 0 22 0 602071551 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23829] ppid=23783 vsize=15706172 CPUtime=1.77 cores=0,2,4,6
/proc/23785/task/23829/stat : 23829 (java) S 23783 23785 23457 0 -1 4202560 22958 0 0 0 175 2 0 0 17 0 22 0 602071551 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23830] ppid=23783 vsize=15706172 CPUtime=1.66 cores=0,2,4,6
/proc/23785/task/23830/stat : 23830 (java) S 23783 23785 23457 0 -1 4202560 18546 0 0 0 164 2 0 0 17 0 22 0 602071551 16083120128 189854 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10.22
Current children cumulated vsize (KiB) 15706172

[startup+6.30067 s]
/proc/loadavg: 4.23 5.51 6.87 9/220 23834
/proc/meminfo: memFree=28638676/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15706172 CPUtime=22.96 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 362077 0 1 0 2242 54 0 0 25 0 22 0 602071513 16083120128 352166 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3926543 352167 2278 9 0 3917262 0
[pid=23785/tid=23787] ppid=23783 vsize=15706172 CPUtime=0.96 cores=0,2,4,6
/proc/23785/task/23787/stat : 23787 (java) S 23783 23785 23457 0 -1 4202560 22070 0 1 0 93 3 0 0 18 0 22 0 602071514 16083120128 352168 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23788] ppid=23783 vsize=15706172 CPUtime=0.06 cores=0,2,4,6
/proc/23785/task/23788/stat : 23788 (java) S 23783 23785 23457 0 -1 4202560 16474 0 0 0 4 2 0 0 16 0 22 0 602071515 16083120128 352169 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23789] ppid=23783 vsize=15706172 CPUtime=0.06 cores=0,2,4,6
/proc/23785/task/23789/stat : 23789 (java) S 23783 23785 23457 0 -1 4202560 20405 0 0 0 3 3 0 0 15 0 22 0 602071515 16083120128 352170 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23790] ppid=23783 vsize=15706172 CPUtime=0.01 cores=0,2,4,6
/proc/23785/task/23790/stat : 23790 (java) S 23783 23785 23457 0 -1 4202560 5333 0 0 0 1 0 0 0 15 0 22 0 602071515 16083120128 352171 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23791] ppid=23783 vsize=15706172 CPUtime=0.08 cores=0,2,4,6
/proc/23785/task/23791/stat : 23791 (java) S 23783 23785 23457 0 -1 4202560 23210 0 0 0 5 3 0 0 16 0 22 0 602071515 16083120128 352172 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23792] ppid=23783 vsize=15706172 CPUtime=0.09 cores=0,2,4,6
/proc/23785/task/23792/stat : 23792 (java) S 23783 23785 23457 0 -1 4202560 20959 0 0 0 6 3 0 0 16 0 22 0 602071515 16083120128 352174 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23793] ppid=23783 vsize=15706172 CPUtime=0.1 cores=0,2,4,6
/proc/23785/task/23793/stat : 23793 (java) S 23783 23785 23457 0 -1 4202560 25825 0 0 0 5 5 0 0 16 0 22 0 602071515 16083120128 352175 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23794] ppid=23783 vsize=15706172 CPUtime=0.06 cores=0,2,4,6
/proc/23785/task/23794/stat : 23794 (java) S 23783 23785 23457 0 -1 4202560 15413 0 0 0 4 2 0 0 15 0 22 0 602071515 16083120128 352176 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23795] ppid=23783 vsize=15706172 CPUtime=0.04 cores=0,2,4,6
/proc/23785/task/23795/stat : 23795 (java) S 23783 23785 23457 0 -1 4202560 12832 0 0 0 2 2 0 0 16 0 22 0 602071515 16083120128 352177 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23797] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23797/stat : 23797 (java) S 23783 23785 23457 0 -1 4202560 856 0 0 0 0 0 0 0 15 0 22 0 602071516 16083120128 352178 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 0 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23802] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23802/stat : 23802 (java) S 23783 23785 23457 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602071516 16083120128 352178 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23803] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23803/stat : 23803 (java) S 23783 23785 23457 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 602071516 16083120128 352179 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23815] ppid=23783 vsize=15706172 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23815/stat : 23815 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 602071518 16083120128 352180 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032219569 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23816] ppid=23783 vsize=15706172 CPUtime=1.03 cores=0,2,4,6
/proc/23785/task/23816/stat : 23816 (java) S 23783 23785 23457 0 -1 4202560 12203 0 0 0 102 1 0 0 15 0 22 0 602071518 16083120128 352181 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0

################
# More data... #
################

/proc/meminfo: memFree=26150724/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15694744 CPUtime=4477.94 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 2600529 0 1 0 447394 400 0 0 25 0 22 0 602071513 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3923686 1041880 2298 9 0 3914405 0
[pid=23785/tid=23787] ppid=23783 vsize=15694744 CPUtime=0.96 cores=0,2,4,6
/proc/23785/task/23787/stat : 23787 (java) S 23783 23785 23457 0 -1 4202560 22070 0 1 0 93 3 0 0 18 0 22 0 602071514 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23788] ppid=23783 vsize=15694744 CPUtime=1.79 cores=0,2,4,6
/proc/23785/task/23788/stat : 23788 (java) S 23783 23785 23457 0 -1 4202560 175643 0 0 0 148 31 0 0 15 0 22 0 602071515 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23789] ppid=23783 vsize=15694744 CPUtime=2.03 cores=0,2,4,6
/proc/23785/task/23789/stat : 23789 (java) S 23783 23785 23457 0 -1 4202560 181338 0 0 0 173 30 0 0 15 0 22 0 602071515 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23790] ppid=23783 vsize=15694744 CPUtime=1.84 cores=0,2,4,6
/proc/23785/task/23790/stat : 23790 (java) S 23783 23785 23457 0 -1 4202560 164434 0 0 0 157 27 0 0 16 0 22 0 602071515 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23791] ppid=23783 vsize=15694744 CPUtime=1.98 cores=0,2,4,6
/proc/23785/task/23791/stat : 23791 (java) S 23783 23785 23457 0 -1 4202560 182591 0 0 0 167 31 0 0 16 0 22 0 602071515 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23792] ppid=23783 vsize=15694744 CPUtime=1.96 cores=0,2,4,6
/proc/23785/task/23792/stat : 23792 (java) S 23783 23785 23457 0 -1 4202560 201340 0 0 0 168 28 0 0 16 0 22 0 602071515 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23793] ppid=23783 vsize=15694744 CPUtime=1.89 cores=0,2,4,6
/proc/23785/task/23793/stat : 23793 (java) S 23783 23785 23457 0 -1 4202560 181467 0 0 0 159 30 0 0 15 0 22 0 602071515 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23794] ppid=23783 vsize=15694744 CPUtime=2 cores=0,2,4,6
/proc/23785/task/23794/stat : 23794 (java) S 23783 23785 23457 0 -1 4202560 169633 0 0 0 168 32 0 0 16 0 22 0 602071515 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23795] ppid=23783 vsize=15694744 CPUtime=1.81 cores=0,2,4,6
/proc/23785/task/23795/stat : 23795 (java) S 23783 23785 23457 0 -1 4202560 117773 0 0 0 162 19 0 0 15 0 22 0 602071515 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23797] ppid=23783 vsize=15694744 CPUtime=0.79 cores=0,2,4,6
/proc/23785/task/23797/stat : 23797 (java) S 23783 23785 23457 0 -1 4202560 12966 0 0 0 53 26 0 0 15 0 22 0 602071516 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 0 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23802] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23802/stat : 23802 (java) S 23783 23785 23457 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602071516 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23803] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23803/stat : 23803 (java) S 23783 23785 23457 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 602071516 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23815] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23815/stat : 23815 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 602071518 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032219569 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23816] ppid=23783 vsize=15694744 CPUtime=1.17 cores=0,2,4,6
/proc/23785/task/23816/stat : 23816 (java) S 23783 23785 23457 0 -1 4202560 12227 0 0 0 116 1 0 0 15 0 22 0 602071518 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23817] ppid=23783 vsize=15694744 CPUtime=1.21 cores=0,2,4,6
/proc/23785/task/23817/stat : 23817 (java) S 23783 23785 23457 0 -1 4202560 7745 0 0 0 119 2 0 0 15 0 22 0 602071519 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23818] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23818/stat : 23818 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 602071519 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23819] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23819/stat : 23819 (java) S 23783 23785 23457 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 602071519 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23827] ppid=23783 vsize=15694744 CPUtime=1110.48 cores=0,2,4,6
/proc/23785/task/23827/stat : 23827 (java) R 23783 23785 23457 0 -1 4202560 291167 0 0 0 111016 32 0 0 25 0 22 0 602071551 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912505604263 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23785/tid=23828] ppid=23783 vsize=15694744 CPUtime=1116.45 cores=0,2,4,6
/proc/23785/task/23828/stat : 23828 (java) R 23783 23785 23457 0 -1 4202560 296244 0 0 0 111609 36 0 0 25 0 22 0 602071551 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912505986212 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23785/tid=23829] ppid=23783 vsize=15694744 CPUtime=1115.56 cores=0,2,4,6
/proc/23785/task/23829/stat : 23829 (java) R 23783 23785 23457 0 -1 4202560 302958 0 0 0 111523 33 0 0 25 0 22 0 602071551 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912505753976 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23785/tid=23830] ppid=23783 vsize=15694744 CPUtime=1115.87 cores=0,2,4,6
/proc/23785/task/23830/stat : 23830 (java) R 23783 23785 23457 0 -1 4202560 279482 0 0 0 111555 32 0 0 25 0 22 0 602071551 16071417856 1041880 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912505708520 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4477.94
Current children cumulated vsize (KiB) 15694744

[startup+1182.3 s]
/proc/loadavg: 8.14 8.10 7.74 9/220 23865
/proc/meminfo: memFree=27166800/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15694744 CPUtime=4717.43 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 2615360 0 1 0 471335 408 0 0 25 0 22 0 602071513 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3923686 780918 2298 9 0 3914405 0
[pid=23785/tid=23787] ppid=23783 vsize=15694744 CPUtime=0.96 cores=0,2,4,6
/proc/23785/task/23787/stat : 23787 (java) S 23783 23785 23457 0 -1 4202560 22070 0 1 0 93 3 0 0 18 0 22 0 602071514 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23788] ppid=23783 vsize=15694744 CPUtime=1.82 cores=0,2,4,6
/proc/23785/task/23788/stat : 23788 (java) S 23783 23785 23457 0 -1 4202560 175643 0 0 0 151 31 0 0 15 0 22 0 602071515 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23789] ppid=23783 vsize=15694744 CPUtime=2.16 cores=0,2,4,6
/proc/23785/task/23789/stat : 23789 (java) S 23783 23785 23457 0 -1 4202560 185112 0 0 0 186 30 0 0 16 0 22 0 602071515 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23790] ppid=23783 vsize=15694744 CPUtime=1.95 cores=0,2,4,6
/proc/23785/task/23790/stat : 23790 (java) S 23783 23785 23457 0 -1 4202560 168087 0 0 0 167 28 0 0 15 0 22 0 602071515 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23791] ppid=23783 vsize=15694744 CPUtime=2.06 cores=0,2,4,6
/proc/23785/task/23791/stat : 23791 (java) S 23783 23785 23457 0 -1 4202560 182591 0 0 0 175 31 0 0 16 0 22 0 602071515 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23792] ppid=23783 vsize=15694744 CPUtime=2.09 cores=0,2,4,6
/proc/23785/task/23792/stat : 23792 (java) S 23783 23785 23457 0 -1 4202560 205095 0 0 0 180 29 0 0 15 0 22 0 602071515 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23793] ppid=23783 vsize=15694744 CPUtime=2.02 cores=0,2,4,6
/proc/23785/task/23793/stat : 23793 (java) S 23783 23785 23457 0 -1 4202560 181473 0 0 0 172 30 0 0 16 0 22 0 602071515 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23794] ppid=23783 vsize=15694744 CPUtime=2.14 cores=0,2,4,6
/proc/23785/task/23794/stat : 23794 (java) S 23783 23785 23457 0 -1 4202560 173214 0 0 0 181 33 0 0 16 0 22 0 602071515 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23795] ppid=23783 vsize=15694744 CPUtime=1.91 cores=0,2,4,6
/proc/23785/task/23795/stat : 23795 (java) S 23783 23785 23457 0 -1 4202560 117814 0 0 0 172 19 0 0 15 0 22 0 602071515 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23797] ppid=23783 vsize=15694744 CPUtime=0.83 cores=0,2,4,6
/proc/23785/task/23797/stat : 23797 (java) S 23783 23785 23457 0 -1 4202560 12970 0 0 0 53 30 0 0 15 0 22 0 602071516 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 0 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23802] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23802/stat : 23802 (java) S 23783 23785 23457 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602071516 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23803] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23803/stat : 23803 (java) S 23783 23785 23457 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 602071516 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23815] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23815/stat : 23815 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 602071518 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032219569 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23816] ppid=23783 vsize=15694744 CPUtime=1.17 cores=0,2,4,6
/proc/23785/task/23816/stat : 23816 (java) S 23783 23785 23457 0 -1 4202560 12227 0 0 0 116 1 0 0 15 0 22 0 602071518 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23817] ppid=23783 vsize=15694744 CPUtime=1.21 cores=0,2,4,6
/proc/23785/task/23817/stat : 23817 (java) S 23783 23785 23457 0 -1 4202560 7745 0 0 0 119 2 0 0 15 0 22 0 602071519 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23818] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23818/stat : 23818 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 602071519 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23819] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23819/stat : 23819 (java) S 23783 23785 23457 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 602071519 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23827] ppid=23783 vsize=15694744 CPUtime=1169.88 cores=0,2,4,6
/proc/23785/task/23827/stat : 23827 (java) R 23783 23785 23457 0 -1 4202560 291170 0 0 0 116956 32 0 0 25 0 22 0 602071551 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912506202152 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23785/tid=23828] ppid=23783 vsize=15694744 CPUtime=1176.18 cores=0,2,4,6
/proc/23785/task/23828/stat : 23828 (java) R 23783 23785 23457 0 -1 4202560 296247 0 0 0 117582 36 0 0 25 0 22 0 602071551 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912506252408 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23785/tid=23829] ppid=23783 vsize=15694744 CPUtime=1175.29 cores=0,2,4,6
/proc/23785/task/23829/stat : 23829 (java) R 23783 23785 23457 0 -1 4202560 302961 0 0 0 117496 33 0 0 25 0 22 0 602071551 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912505787702 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23785/tid=23830] ppid=23783 vsize=15694744 CPUtime=1175.6 cores=0,2,4,6
/proc/23785/task/23830/stat : 23830 (java) R 23783 23785 23457 0 -1 4202560 279486 0 0 0 117528 32 0 0 25 0 22 0 602071551 16071417856 780918 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912506266084 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4717.43
Current children cumulated vsize (KiB) 15694744



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.34 8.14 7.76 9/220 23866
/proc/meminfo: memFree=27615296/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=15694744 CPUtime=4800.06 cores=0,2,4,6
/proc/23785/stat : 23785 (java) S 23783 23785 23457 0 -1 4202496 2615370 0 1 0 479595 411 0 0 25 0 22 0 602071513 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 3923686 670415 2298 9 0 3914405 0
[pid=23785/tid=23787] ppid=23783 vsize=15694744 CPUtime=0.96 cores=0,2,4,6
/proc/23785/task/23787/stat : 23787 (java) S 23783 23785 23457 0 -1 4202560 22070 0 1 0 93 3 0 0 18 0 22 0 602071514 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23788] ppid=23783 vsize=15694744 CPUtime=1.87 cores=0,2,4,6
/proc/23785/task/23788/stat : 23788 (java) S 23783 23785 23457 0 -1 4202560 175643 0 0 0 156 31 0 0 15 0 22 0 602071515 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23789] ppid=23783 vsize=15694744 CPUtime=2.2 cores=0,2,4,6
/proc/23785/task/23789/stat : 23789 (java) S 23783 23785 23457 0 -1 4202560 185112 0 0 0 190 30 0 0 16 0 22 0 602071515 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23790] ppid=23783 vsize=15694744 CPUtime=2.02 cores=0,2,4,6
/proc/23785/task/23790/stat : 23790 (java) S 23783 23785 23457 0 -1 4202560 168087 0 0 0 174 28 0 0 16 0 22 0 602071515 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23791] ppid=23783 vsize=15694744 CPUtime=2.1 cores=0,2,4,6
/proc/23785/task/23791/stat : 23791 (java) S 23783 23785 23457 0 -1 4202560 182591 0 0 0 179 31 0 0 15 0 22 0 602071515 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23792] ppid=23783 vsize=15694744 CPUtime=2.13 cores=0,2,4,6
/proc/23785/task/23792/stat : 23792 (java) S 23783 23785 23457 0 -1 4202560 205095 0 0 0 184 29 0 0 15 0 22 0 602071515 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23793] ppid=23783 vsize=15694744 CPUtime=2.05 cores=0,2,4,6
/proc/23785/task/23793/stat : 23793 (java) S 23783 23785 23457 0 -1 4202560 181473 0 0 0 175 30 0 0 15 0 22 0 602071515 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23794] ppid=23783 vsize=15694744 CPUtime=2.23 cores=0,2,4,6
/proc/23785/task/23794/stat : 23794 (java) S 23783 23785 23457 0 -1 4202560 173214 0 0 0 190 33 0 0 16 0 22 0 602071515 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23795] ppid=23783 vsize=15694744 CPUtime=1.96 cores=0,2,4,6
/proc/23785/task/23795/stat : 23795 (java) S 23783 23785 23457 0 -1 4202560 117814 0 0 0 177 19 0 0 16 0 22 0 602071515 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23797] ppid=23783 vsize=15694744 CPUtime=0.85 cores=0,2,4,6
/proc/23785/task/23797/stat : 23797 (java) S 23783 23785 23457 0 -1 4202560 12972 0 0 0 53 32 0 0 15 0 22 0 602071516 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 0 0 16800975 18446604453616616448 0 0 -1 0 0 0 0
[pid=23785/tid=23802] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23802/stat : 23802 (java) S 23783 23785 23457 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 602071516 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23803] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23803/stat : 23803 (java) S 23783 23785 23457 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 602071516 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23815] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23815/stat : 23815 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 602071518 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032219569 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23816] ppid=23783 vsize=15694744 CPUtime=1.17 cores=0,2,4,6
/proc/23785/task/23816/stat : 23816 (java) S 23783 23785 23457 0 -1 4202560 12227 0 0 0 116 1 0 0 15 0 22 0 602071518 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23817] ppid=23783 vsize=15694744 CPUtime=1.21 cores=0,2,4,6
/proc/23785/task/23817/stat : 23817 (java) S 23783 23785 23457 0 -1 4202560 7745 0 0 0 119 2 0 0 15 0 22 0 602071519 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 2 0 0 0
[pid=23785/tid=23818] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23818/stat : 23818 (java) S 23783 23785 23457 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 22 0 602071519 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032211865 0 4 0 16800975 18446604453616616448 0 0 -1 6 0 0 0
[pid=23785/tid=23819] ppid=23783 vsize=15694744 CPUtime=0 cores=0,2,4,6
/proc/23785/task/23819/stat : 23819 (java) S 23783 23785 23457 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 22 0 602071519 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 260032212480 0 4 0 16800975 18446604453616616448 0 0 -1 4 0 0 0
[pid=23785/tid=23827] ppid=23783 vsize=15694744 CPUtime=1190.34 cores=0,2,4,6
/proc/23785/task/23827/stat : 23827 (java) R 23783 23785 23457 0 -1 4202560 291172 0 0 0 119002 32 0 0 25 0 22 0 602071551 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912506239156 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=23785/tid=23828] ppid=23783 vsize=15694744 CPUtime=1196.76 cores=0,2,4,6
/proc/23785/task/23828/stat : 23828 (java) R 23783 23785 23457 0 -1 4202560 296249 0 0 0 119640 36 0 0 25 0 22 0 602071551 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912506202034 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=23785/tid=23829] ppid=23783 vsize=15694744 CPUtime=1195.87 cores=0,2,4,6
/proc/23785/task/23829/stat : 23829 (java) R 23783 23785 23457 0 -1 4202560 302961 0 0 0 119554 33 0 0 25 0 22 0 602071551 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 46912506252931 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=23785/tid=23830] ppid=23783 vsize=15694744 CPUtime=1196.18 cores=0,2,4,6
/proc/23785/task/23830/stat : 23830 (java) R 23783 23785 23457 0 -1 4202560 279488 0 0 0 119586 32 0 0 25 0 22 0 602071551 16071417856 670415 33554432000 1073741824 1073778376 140734837935648 18446744073709551615 18446744073699065947 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 15694744

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.11 s]
/proc/loadavg: 8.34 8.14 7.76 9/220 23866
/proc/meminfo: memFree=27615296/32951124 swapFree=67111464/67111528
[pid=23785] ppid=23783 vsize=0 CPUtime=4800.19 cores=0,2,4,6
/proc/23785/stat : 23785 (java) Z 23783 23785 23457 0 -1 4203548 2615396 0 1 0 479599 420 0 0 17 0 2 0 602071513 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/23785/statm: 0 0 0 0 0 0 0
[pid=23785/tid=23827] ppid=23783 vsize=0 CPUtime=1190.45 cores=0,2,4,6
/proc/23785/task/23827/stat : 23827 (java) R 23783 23785 23457 0 -1 4203588 291172 0 0 0 119003 42 0 0 25 0 2 0 602071551 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1203.13
CPU time (s): 4800.22
CPU user time (s): 4795.99
CPU system time (s): 4.22736
CPU usage (%): 398.977
Max. virtual memory (cumulated for all children) (KiB): 15708888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.99
system time used= 4.22736
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2615396
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 33005
involuntary context switches= 57403

runsolver used 1.9837 second user time and 4.6093 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-30 01:06:49
IDJOB=3311292
IDBENCH=82677
IDSOLVER=1698
FILE ID=node110/3311292-1304118409
RUNJOBID= node110-1304118409-23771
PBS_JOBID= 13170707
Free space on /tmp= 72840 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v5000-c21000-S1781430408-009-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311292-1304118409/watcher-3311292-1304118409 -o /tmp/evaluation-result-3311292-1304118409/solver-3311292-1304118409 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311292-1304118409.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 64eaf16e48e921b573c32a7e8a6347cd
RANDOM SEED=518103271

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30810576 kB
Buffers:        927992 kB
Cached:         741072 kB
SwapCached:         64 kB
Active:         138504 kB
Inactive:      1597780 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30810576 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:            2008 kB
Writeback:           0 kB
AnonPages:       67476 kB
Mapped:          14484 kB
Slab:           341932 kB
PageTables:       4648 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   193152 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72836 MiB
End job on node110 at 2011-04-30 01:26:54