Trace number 3312121

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4758.26 1300.69

General information on the benchmark

NameSAT04/industrial/velev/pipe-sat-1-1/
12pipe_bug6_q0.used-as.sat04-725.cnf
MD5SUMb16e6cb0e63a3228c47c991012afc8b4
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.09868
Satisfiable
(Un)Satisfiability was proved
Number of variables138795
Number of clauses4671352
Sum of the clauses size13877998
Maximum clause length352
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 23881307
Number of clauses of size 3729591
Number of clauses of size 4620
Number of clauses of size 5552
Number of clauses of size over 559281

Solver Data 

0.11/0.12	17:21 INFO : Reading from input HOME/instance-3312121-1304187438.cnf
17.34/16.84	Executor set job limit to 1000000
17.34/16.84	Executor set job limit to 1000000
17.34/16.84	Executor set job limit to 1000000
17.34/16.84	Executor set job limit to 1000000
17.34/16.84	Starting Executor!
17.34/16.84	Starting Executor!
17.34/16.84	Starting Executor!
17.34/16.84	Starting Executor!
76.91/73.82	18:34 INFO : 96378 variables remaining out of 138795
76.91/73.82	18:34 INFO : 23987327 literals remaining out of 18549350

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312121-1304187438/watcher-3312121-1304187438 -o /tmp/evaluation-result-3312121-1304187438/solver-3312121-1304187438 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312121-1304187438.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.52 5.38 6.87 2/186 30622
/proc/meminfo: memFree=30249440/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=27172 CPUtime=0 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 1425 0 0 0 0 0 0 0 25 0 2 0 608974622 27824128 894 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 6793 894 684 9 0 381 0
[pid=30622/tid=30624] ppid=30620 vsize=28384 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) R 30620 30622 29719 0 -1 4202560 71 0 0 0 0 0 0 0 25 0 2 0 608974622 29065216 898 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260015472263 0 0 4096 0 0 0 0 -1 2 0 0 0

[startup+0.0533371 s]
/proc/loadavg: 3.52 5.38 6.87 2/186 30622
/proc/meminfo: memFree=30249440/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15609648 CPUtime=0.04 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 4082 0 1 0 4 0 0 0 25 0 18 0 608974622 15984279552 3520 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3902412 3520 1754 9 0 3893131 0
[pid=30622/tid=30624] ppid=30620 vsize=15609648 CPUtime=0.04 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) R 30620 30622 29719 0 -1 4202560 2663 0 1 0 4 0 0 0 25 0 18 0 608974622 15984279552 3520 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032224635 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 15609648

[startup+0.101183 s]
/proc/loadavg: 3.52 5.38 6.87 2/186 30622
/proc/meminfo: memFree=30249440/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15676872 CPUtime=0.11 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 5546 0 1 0 10 1 0 0 25 0 18 0 608974622 16053116928 4983 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3919218 4983 2116 9 0 3909937 0
[pid=30622/tid=30624] ppid=30620 vsize=15676872 CPUtime=0.08 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) R 30620 30622 29719 0 -1 4202560 3488 0 1 0 8 0 0 0 18 0 18 0 608974622 16053116928 5039 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 47213507792901 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 15676872

[startup+0.300286 s]
/proc/loadavg: 3.52 5.38 6.87 2/186 30622
/proc/meminfo: memFree=30249440/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15679992 CPUtime=0.53 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 14512 0 1 0 51 2 0 0 25 0 18 0 608974622 16056311808 13031 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3919998 13035 2207 9 0 3910717 0
[pid=30622/tid=30624] ppid=30620 vsize=15679992 CPUtime=0.28 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) R 30620 30622 29719 0 -1 4202560 9456 0 1 0 27 1 0 0 18 0 18 0 608974622 16056311808 13037 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912505590898 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 15679992

[startup+0.700243 s]
/proc/loadavg: 3.52 5.38 6.87 2/186 30622
/proc/meminfo: memFree=30249440/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15679844 CPUtime=0.95 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 41998 0 1 0 90 5 0 0 25 0 18 0 608974622 16056160256 40457 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3919961 40457 2222 9 0 3910680 0
[pid=30622/tid=30624] ppid=30620 vsize=15679844 CPUtime=0.67 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) R 30620 30622 29719 0 -1 4202560 35541 0 1 0 64 3 0 0 18 0 18 0 608974622 16056160256 40457 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032222667 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.95
Current children cumulated vsize (KiB) 15679844

[startup+1.50109 s]
/proc/loadavg: 3.52 5.38 6.87 3/212 30648
/proc/meminfo: memFree=29934828/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15679844 CPUtime=1.76 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 51746 0 1 0 170 6 0 0 25 0 18 0 608974622 16056160256 50187 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3919961 50193 2222 9 0 3910680 0
[pid=30622/tid=30624] ppid=30620 vsize=15679844 CPUtime=1.47 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) R 30620 30622 29719 0 -1 4202560 42141 0 1 0 143 4 0 0 19 0 18 0 608974622 16056160256 50196 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912505644947 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=30622/tid=30628] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30628/stat : 30628 (java) S 30620 30622 29719 0 -1 4202560 621 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 50199 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30629] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30629/stat : 30629 (java) S 30620 30622 29719 0 -1 4202560 23 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 50203 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30630] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30630/stat : 30630 (java) S 30620 30622 29719 0 -1 4202560 11 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 50207 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30631] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30631/stat : 30631 (java) S 30620 30622 29719 0 -1 4202560 1558 0 0 0 0 0 0 0 16 0 18 0 608974623 16056160256 50211 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30632] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30632/stat : 30632 (java) S 30620 30622 29719 0 -1 4202560 298 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 50215 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30633] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30633/stat : 30633 (java) S 30620 30622 29719 0 -1 4202560 606 0 0 0 0 0 0 0 16 0 18 0 608974623 16056160256 50219 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30634] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30634/stat : 30634 (java) S 30620 30622 29719 0 -1 4202560 673 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 50223 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30635] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30635/stat : 30635 (java) S 30620 30622 29719 0 -1 4202560 694 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 50227 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30636] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30636/stat : 30636 (java) S 30620 30622 29719 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 18 0 608974624 16056160256 50231 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 0 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30637] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30637/stat : 30637 (java) S 30620 30622 29719 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 18 0 608974624 16056160256 50233 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30638] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30638/stat : 30638 (java) S 30620 30622 29719 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 18 0 608974624 16056160256 50237 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30644] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30644/stat : 30644 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 608974626 16056160256 50240 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032219569 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30645] ppid=30620 vsize=15679844 CPUtime=0.14 cores=0,2,4,6
/proc/30622/task/30645/stat : 30645 (java) S 30620 30622 29719 0 -1 4202560 2433 0 0 0 14 0 0 0 15 0 18 0 608974626 16056160256 50244 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30646] ppid=30620 vsize=15679844 CPUtime=0.09 cores=0,2,4,6
/proc/30622/task/30646/stat : 30646 (java) S 30620 30622 29719 0 -1 4202560 1239 0 0 0 9 0 0 0 17 0 18 0 608974626 16056160256 50248 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30647] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30647/stat : 30647 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 608974626 16056160256 50252 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30648] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30648/stat : 30648 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 608974626 16056160256 50256 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1.76
Current children cumulated vsize (KiB) 15679844

[startup+3.10077 s]
/proc/loadavg: 3.52 5.38 6.87 5/212 30648
/proc/meminfo: memFree=29508144/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15679844 CPUtime=3.42 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 139864 0 1 0 325 17 0 0 25 0 18 0 608974622 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3919961 138297 2240 9 0 3910680 0
[pid=30622/tid=30624] ppid=30620 vsize=15679844 CPUtime=3.06 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) R 30620 30622 29719 0 -1 4202560 127307 0 1 0 291 15 0 0 23 0 18 0 608974622 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912505531044 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=30622/tid=30628] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30628/stat : 30628 (java) S 30620 30622 29719 0 -1 4202560 622 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30629] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30629/stat : 30629 (java) S 30620 30622 29719 0 -1 4202560 2611 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30630] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30630/stat : 30630 (java) S 30620 30622 29719 0 -1 4202560 13 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30631] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30631/stat : 30631 (java) S 30620 30622 29719 0 -1 4202560 1558 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30632] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30632/stat : 30632 (java) S 30620 30622 29719 0 -1 4202560 330 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30633] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30633/stat : 30633 (java) S 30620 30622 29719 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30634] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30634/stat : 30634 (java) S 30620 30622 29719 0 -1 4202560 673 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30635] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30635/stat : 30635 (java) S 30620 30622 29719 0 -1 4202560 694 0 0 0 0 0 0 0 15 0 18 0 608974623 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30636] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30636/stat : 30636 (java) S 30620 30622 29719 0 -1 4202560 197 0 0 0 0 0 0 0 15 0 18 0 608974624 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 0 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30637] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30637/stat : 30637 (java) S 30620 30622 29719 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 18 0 608974624 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30638] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30638/stat : 30638 (java) S 30620 30622 29719 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 18 0 608974624 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30644] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30644/stat : 30644 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 608974626 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032219569 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30645] ppid=30620 vsize=15679844 CPUtime=0.17 cores=0,2,4,6
/proc/30622/task/30645/stat : 30645 (java) S 30620 30622 29719 0 -1 4202560 2477 0 0 0 17 0 0 0 15 0 18 0 608974626 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30646] ppid=30620 vsize=15679844 CPUtime=0.11 cores=0,2,4,6
/proc/30622/task/30646/stat : 30646 (java) S 30620 30622 29719 0 -1 4202560 1243 0 0 0 11 0 0 0 15 0 18 0 608974626 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30647] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30647/stat : 30647 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 608974626 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30648] ppid=30620 vsize=15679844 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30648/stat : 30648 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 608974626 16056160256 138297 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.42
Current children cumulated vsize (KiB) 15679844

[startup+6.30122 s]
/proc/loadavg: 3.64 5.38 6.86 3/212 30648
/proc/meminfo: memFree=28535996/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15678360 CPUtime=6.7 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 155515 0 1 0 650 20 0 0 25 0 18 0 608974622 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3919590 150937 2240 9 0 3910309 0
[pid=30622/tid=30624] ppid=30620 vsize=15678360 CPUtime=6.22 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) R 30620 30622 29719 0 -1 4202560 127314 0 1 0 606 16 0 0 25 0 18 0 608974622 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912505642744 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=30622/tid=30628] ppid=30620 vsize=15678360 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30628/stat : 30628 (java) S 30620 30622 29719 0 -1 4202560 622 0 0 0 0 0 0 0 15 0 18 0 608974623 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30629] ppid=30620 vsize=15678360 CPUtime=0.01 cores=0,2,4,6
/proc/30622/task/30629/stat : 30629 (java) S 30620 30622 29719 0 -1 4202560 2611 0 0 0 1 0 0 0 15 0 18 0 608974623 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30630] ppid=30620 vsize=15678360 CPUtime=0.02 cores=0,2,4,6
/proc/30622/task/30630/stat : 30630 (java) S 30620 30622 29719 0 -1 4202560 13 0 0 0 2 0 0 0 15 0 18 0 608974623 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30631] ppid=30620 vsize=15678360 CPUtime=0.01 cores=0,2,4,6
/proc/30622/task/30631/stat : 30631 (java) S 30620 30622 29719 0 -1 4202560 1558 0 0 0 1 0 0 0 15 0 18 0 608974623 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30632] ppid=30620 vsize=15678360 CPUtime=0.01 cores=0,2,4,6
/proc/30622/task/30632/stat : 30632 (java) S 30620 30622 29719 0 -1 4202560 330 0 0 0 1 0 0 0 15 0 18 0 608974623 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30633] ppid=30620 vsize=15678360 CPUtime=0.02 cores=0,2,4,6
/proc/30622/task/30633/stat : 30633 (java) S 30620 30622 29719 0 -1 4202560 5872 0 0 0 2 0 0 0 15 0 18 0 608974623 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30634] ppid=30620 vsize=15678360 CPUtime=0.01 cores=0,2,4,6
/proc/30622/task/30634/stat : 30634 (java) S 30620 30622 29719 0 -1 4202560 673 0 0 0 1 0 0 0 15 0 18 0 608974623 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30635] ppid=30620 vsize=15678360 CPUtime=0.02 cores=0,2,4,6
/proc/30622/task/30635/stat : 30635 (java) S 30620 30622 29719 0 -1 4202560 10936 0 0 0 1 1 0 0 15 0 18 0 608974623 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30636] ppid=30620 vsize=15678360 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30636/stat : 30636 (java) S 30620 30622 29719 0 -1 4202560 479 0 0 0 0 0 0 0 15 0 18 0 608974624 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 0 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30637] ppid=30620 vsize=15678360 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30637/stat : 30637 (java) S 30620 30622 29719 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 18 0 608974624 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30638] ppid=30620 vsize=15678360 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30638/stat : 30638 (java) S 30620 30622 29719 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 18 0 608974624 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30644] ppid=30620 vsize=15678360 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30644/stat : 30644 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 608974626 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032219569 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30645] ppid=30620 vsize=15678360 CPUtime=0.17 cores=0,2,4,6
/proc/30622/task/30645/stat : 30645 (java) S 30620 30622 29719 0 -1 4202560 2477 0 0 0 17 0 0 0 15 0 18 0 608974626 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30646] ppid=30620 vsize=15678360 CPUtime=0.11 cores=0,2,4,6
/proc/30622/task/30646/stat : 30646 (java) S 30620 30622 29719 0 -1 4202560 1243 0 0 0 11 0 0 0 15 0 18 0 608974626 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30647] ppid=30620 vsize=15678360 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30647/stat : 30647 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 608974626 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30648] ppid=30620 vsize=15678360 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30648/stat : 30648 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 608974626 16054640640 150937 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0

################
# More data... #
################

/proc/30622/task/30630/stat : 30630 (java) S 30620 30622 29719 0 -1 4202560 439098 0 0 0 604 77 0 0 16 0 22 0 608974623 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30631] ppid=30620 vsize=15717328 CPUtime=9.09 cores=0,2,4,6
/proc/30622/task/30631/stat : 30631 (java) S 30620 30622 29719 0 -1 4202560 555880 0 0 0 823 86 0 0 16 0 22 0 608974623 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30632] ppid=30620 vsize=15717328 CPUtime=8.31 cores=0,2,4,6
/proc/30622/task/30632/stat : 30632 (java) S 30620 30622 29719 0 -1 4202560 474207 0 0 0 749 82 0 0 16 0 22 0 608974623 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30633] ppid=30620 vsize=15717328 CPUtime=7.57 cores=0,2,4,6
/proc/30622/task/30633/stat : 30633 (java) S 30620 30622 29719 0 -1 4202560 509208 0 0 0 669 88 0 0 16 0 22 0 608974623 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30634] ppid=30620 vsize=15717328 CPUtime=8.85 cores=0,2,4,6
/proc/30622/task/30634/stat : 30634 (java) S 30620 30622 29719 0 -1 4202560 352358 0 0 0 828 57 0 0 16 0 22 0 608974623 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30635] ppid=30620 vsize=15717328 CPUtime=8.12 cores=0,2,4,6
/proc/30622/task/30635/stat : 30635 (java) S 30620 30622 29719 0 -1 4202560 439170 0 0 0 735 77 0 0 16 0 22 0 608974623 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30636] ppid=30620 vsize=15717328 CPUtime=15.25 cores=0,2,4,6
/proc/30622/task/30636/stat : 30636 (java) S 30620 30622 29719 0 -1 4202560 134210 0 0 0 1506 19 0 0 15 0 22 0 608974624 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 0 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30637] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30637/stat : 30637 (java) S 30620 30622 29719 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 608974624 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30638] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30638/stat : 30638 (java) S 30620 30622 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608974624 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30644] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30644/stat : 30644 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608974626 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032219569 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30645] ppid=30620 vsize=15717328 CPUtime=0.99 cores=0,2,4,6
/proc/30622/task/30645/stat : 30645 (java) S 30620 30622 29719 0 -1 4202560 7465 0 0 0 98 1 0 0 15 0 22 0 608974626 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30646] ppid=30620 vsize=15717328 CPUtime=1.78 cores=0,2,4,6
/proc/30622/task/30646/stat : 30646 (java) S 30620 30622 29719 0 -1 4202560 14044 0 0 0 177 1 0 0 15 0 22 0 608974626 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30647] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30647/stat : 30647 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608974626 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30648] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30648/stat : 30648 (java) S 30620 30622 29719 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 608974626 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30653] ppid=30620 vsize=15717328 CPUtime=1073.44 cores=0,2,4,6
/proc/30622/task/30653/stat : 30653 (java) R 30620 30622 29719 0 -1 4202560 63 0 0 0 107344 0 0 0 20 0 22 0 608976306 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912506120772 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=30622/tid=30654] ppid=30620 vsize=15717328 CPUtime=972.66 cores=0,2,4,6
/proc/30622/task/30654/stat : 30654 (java) R 30620 30622 29719 0 -1 4202560 29 0 0 0 97266 0 0 0 20 0 22 0 608976306 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912505981504 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=30622/tid=30655] ppid=30620 vsize=15717328 CPUtime=1021.91 cores=0,2,4,6
/proc/30622/task/30655/stat : 30655 (java) R 30620 30622 29719 0 -1 4202560 48 0 0 0 102191 0 0 0 20 0 22 0 608976306 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912506120772 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=30622/tid=30656] ppid=30620 vsize=15717328 CPUtime=1075.25 cores=0,2,4,6
/proc/30622/task/30656/stat : 30656 (java) R 30620 30622 29719 0 -1 4202560 42 0 0 0 107525 0 0 0 20 0 22 0 608976306 16094543872 3774069 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912506135313 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4298.79
Current children cumulated vsize (KiB) 15717328

[startup+1242.3 s]
/proc/loadavg: 8.05 7.94 7.49 9/220 30689
/proc/meminfo: memFree=1333308/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15717328 CPUtime=4534.23 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 3976509 0 1 0 452756 667 0 0 25 0 22 0 608974622 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3929332 3822384 2294 9 0 3920051 0
[pid=30622/tid=30624] ppid=30620 vsize=15717328 CPUtime=72.79 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) S 30620 30622 29719 0 -1 4202560 191903 0 1 0 7252 27 0 0 25 0 22 0 608974622 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30628] ppid=30620 vsize=15717328 CPUtime=7.72 cores=0,2,4,6
/proc/30622/task/30628/stat : 30628 (java) S 30620 30622 29719 0 -1 4202560 495935 0 0 0 690 82 0 0 16 0 22 0 608974623 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30629] ppid=30620 vsize=15717328 CPUtime=8.07 cores=0,2,4,6
/proc/30622/task/30629/stat : 30629 (java) S 30620 30622 29719 0 -1 4202560 313073 0 0 0 753 54 0 0 16 0 22 0 608974623 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30630] ppid=30620 vsize=15717328 CPUtime=6.81 cores=0,2,4,6
/proc/30622/task/30630/stat : 30630 (java) S 30620 30622 29719 0 -1 4202560 439098 0 0 0 604 77 0 0 16 0 22 0 608974623 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30631] ppid=30620 vsize=15717328 CPUtime=9.09 cores=0,2,4,6
/proc/30622/task/30631/stat : 30631 (java) S 30620 30622 29719 0 -1 4202560 555880 0 0 0 823 86 0 0 16 0 22 0 608974623 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30632] ppid=30620 vsize=15717328 CPUtime=8.31 cores=0,2,4,6
/proc/30622/task/30632/stat : 30632 (java) S 30620 30622 29719 0 -1 4202560 474207 0 0 0 749 82 0 0 16 0 22 0 608974623 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30633] ppid=30620 vsize=15717328 CPUtime=7.57 cores=0,2,4,6
/proc/30622/task/30633/stat : 30633 (java) S 30620 30622 29719 0 -1 4202560 509208 0 0 0 669 88 0 0 16 0 22 0 608974623 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30634] ppid=30620 vsize=15717328 CPUtime=8.85 cores=0,2,4,6
/proc/30622/task/30634/stat : 30634 (java) S 30620 30622 29719 0 -1 4202560 352358 0 0 0 828 57 0 0 16 0 22 0 608974623 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30635] ppid=30620 vsize=15717328 CPUtime=8.12 cores=0,2,4,6
/proc/30622/task/30635/stat : 30635 (java) S 30620 30622 29719 0 -1 4202560 439170 0 0 0 735 77 0 0 16 0 22 0 608974623 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30636] ppid=30620 vsize=15717328 CPUtime=16.67 cores=0,2,4,6
/proc/30622/task/30636/stat : 30636 (java) S 30620 30622 29719 0 -1 4202560 182527 0 0 0 1641 26 0 0 15 0 22 0 608974624 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 0 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30637] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30637/stat : 30637 (java) S 30620 30622 29719 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 608974624 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30638] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30638/stat : 30638 (java) S 30620 30622 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608974624 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30644] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30644/stat : 30644 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608974626 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032219569 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30645] ppid=30620 vsize=15717328 CPUtime=0.99 cores=0,2,4,6
/proc/30622/task/30645/stat : 30645 (java) S 30620 30622 29719 0 -1 4202560 7465 0 0 0 98 1 0 0 15 0 22 0 608974626 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30646] ppid=30620 vsize=15717328 CPUtime=1.78 cores=0,2,4,6
/proc/30622/task/30646/stat : 30646 (java) S 30620 30622 29719 0 -1 4202560 14044 0 0 0 177 1 0 0 15 0 22 0 608974626 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30647] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30647/stat : 30647 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608974626 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30648] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30648/stat : 30648 (java) S 30620 30622 29719 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 608974626 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30653] ppid=30620 vsize=15717328 CPUtime=1132.02 cores=0,2,4,6
/proc/30622/task/30653/stat : 30653 (java) R 30620 30622 29719 0 -1 4202560 64 0 0 0 113202 0 0 0 25 0 22 0 608976306 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912505605752 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=30622/tid=30654] ppid=30620 vsize=15717328 CPUtime=1030.93 cores=0,2,4,6
/proc/30622/task/30654/stat : 30654 (java) R 30620 30622 29719 0 -1 4202560 29 0 0 0 103093 0 0 0 25 0 22 0 608976306 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912506120832 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=30622/tid=30655] ppid=30620 vsize=15717328 CPUtime=1080.5 cores=0,2,4,6
/proc/30622/task/30655/stat : 30655 (java) R 30620 30622 29719 0 -1 4202560 49 0 0 0 108050 0 0 0 25 0 22 0 608976306 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912505828506 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=30622/tid=30656] ppid=30620 vsize=15717328 CPUtime=1133.83 cores=0,2,4,6
/proc/30622/task/30656/stat : 30656 (java) R 30620 30622 29719 0 -1 4202560 42 0 0 0 113383 0 0 0 25 0 22 0 608976306 16094543872 3822384 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912506120841 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4534.23
Current children cumulated vsize (KiB) 15717328



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 8.10 7.96 7.52 7/202 30696
/proc/meminfo: memFree=1367156/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=15717328 CPUtime=4757.27 cores=0,2,4,6
/proc/30622/stat : 30622 (java) S 30620 30622 29719 0 -1 4202496 3980320 0 1 0 475059 668 0 0 25 0 22 0 608974622 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 3929332 3826186 2294 9 0 3920051 0
[pid=30622/tid=30624] ppid=30620 vsize=15717328 CPUtime=72.79 cores=0,2,4,6
/proc/30622/task/30624/stat : 30624 (java) S 30620 30622 29719 0 -1 4202560 191903 0 1 0 7252 27 0 0 25 0 22 0 608974622 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30628] ppid=30620 vsize=15717328 CPUtime=7.72 cores=0,2,4,6
/proc/30622/task/30628/stat : 30628 (java) S 30620 30622 29719 0 -1 4202560 495935 0 0 0 690 82 0 0 16 0 22 0 608974623 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30629] ppid=30620 vsize=15717328 CPUtime=8.07 cores=0,2,4,6
/proc/30622/task/30629/stat : 30629 (java) S 30620 30622 29719 0 -1 4202560 313073 0 0 0 753 54 0 0 16 0 22 0 608974623 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30630] ppid=30620 vsize=15717328 CPUtime=6.81 cores=0,2,4,6
/proc/30622/task/30630/stat : 30630 (java) S 30620 30622 29719 0 -1 4202560 439098 0 0 0 604 77 0 0 16 0 22 0 608974623 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30631] ppid=30620 vsize=15717328 CPUtime=9.09 cores=0,2,4,6
/proc/30622/task/30631/stat : 30631 (java) S 30620 30622 29719 0 -1 4202560 555880 0 0 0 823 86 0 0 16 0 22 0 608974623 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30632] ppid=30620 vsize=15717328 CPUtime=8.31 cores=0,2,4,6
/proc/30622/task/30632/stat : 30632 (java) S 30620 30622 29719 0 -1 4202560 474207 0 0 0 749 82 0 0 16 0 22 0 608974623 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30633] ppid=30620 vsize=15717328 CPUtime=7.57 cores=0,2,4,6
/proc/30622/task/30633/stat : 30633 (java) S 30620 30622 29719 0 -1 4202560 509208 0 0 0 669 88 0 0 16 0 22 0 608974623 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30634] ppid=30620 vsize=15717328 CPUtime=8.85 cores=0,2,4,6
/proc/30622/task/30634/stat : 30634 (java) S 30620 30622 29719 0 -1 4202560 352358 0 0 0 828 57 0 0 16 0 22 0 608974623 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30635] ppid=30620 vsize=15717328 CPUtime=8.12 cores=0,2,4,6
/proc/30622/task/30635/stat : 30635 (java) S 30620 30622 29719 0 -1 4202560 439170 0 0 0 735 77 0 0 16 0 22 0 608974623 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30636] ppid=30620 vsize=15717328 CPUtime=19.16 cores=0,2,4,6
/proc/30622/task/30636/stat : 30636 (java) S 30620 30622 29719 0 -1 4202560 186331 0 0 0 1889 27 0 0 15 0 22 0 608974624 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 0 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30637] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30637/stat : 30637 (java) S 30620 30622 29719 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 608974624 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30638] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30638/stat : 30638 (java) S 30620 30622 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608974624 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 0 0 0 0
[pid=30622/tid=30644] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30644/stat : 30644 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608974626 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032219569 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30645] ppid=30620 vsize=15717328 CPUtime=0.99 cores=0,2,4,6
/proc/30622/task/30645/stat : 30645 (java) S 30620 30622 29719 0 -1 4202560 7465 0 0 0 98 1 0 0 15 0 22 0 608974626 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30646] ppid=30620 vsize=15717328 CPUtime=1.78 cores=0,2,4,6
/proc/30622/task/30646/stat : 30646 (java) S 30620 30622 29719 0 -1 4202560 14044 0 0 0 177 1 0 0 15 0 22 0 608974626 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 2 0 0 0
[pid=30622/tid=30647] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30647/stat : 30647 (java) S 30620 30622 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608974626 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032211865 0 4 0 16800975 18446604453930384192 0 0 -1 6 0 0 0
[pid=30622/tid=30648] ppid=30620 vsize=15717328 CPUtime=0 cores=0,2,4,6
/proc/30622/task/30648/stat : 30648 (java) S 30620 30622 29719 0 -1 4202560 75 0 0 0 0 0 0 0 15 0 22 0 608974626 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 260032212480 0 4 0 16800975 18446604453930384192 0 0 -1 4 0 0 0
[pid=30622/tid=30653] ppid=30620 vsize=15717328 CPUtime=1187.23 cores=0,2,4,6
/proc/30622/task/30653/stat : 30653 (java) R 30620 30622 29719 0 -1 4202560 66 0 0 0 118723 0 0 0 25 0 22 0 608976306 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912505588208 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=30622/tid=30654] ppid=30620 vsize=15717328 CPUtime=1085.84 cores=0,2,4,6
/proc/30622/task/30654/stat : 30654 (java) R 30620 30622 29719 0 -1 4202560 30 0 0 0 108584 0 0 0 25 0 22 0 608976306 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912506135673 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=30622/tid=30655] ppid=30620 vsize=15717328 CPUtime=1135.72 cores=0,2,4,6
/proc/30622/task/30655/stat : 30655 (java) R 30620 30622 29719 0 -1 4202560 49 0 0 0 113572 0 0 0 25 0 22 0 608976306 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912506089692 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=30622/tid=30656] ppid=30620 vsize=15717328 CPUtime=1189.05 cores=0,2,4,6
/proc/30622/task/30656/stat : 30656 (java) R 30620 30622 29719 0 -1 4202560 42 0 0 0 118905 0 0 0 25 0 22 0 608976306 16094543872 3826186 33554432000 1073741824 1073778376 140736795014032 18446744073709551615 46912506135321 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4757.27
Current children cumulated vsize (KiB) 15717328

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.4 s]
/proc/loadavg: 8.10 7.96 7.52 7/202 30696
/proc/meminfo: memFree=1367156/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=0 CPUtime=4757.96 cores=0,2,4,6
/proc/30622/stat : 30622 (java) Z 30620 30622 29719 0 -1 4203548 3980347 0 1 0 475098 698 0 0 17 0 2 0 608974622 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 0 0 0 0 0 0 0
[pid=30622/tid=30655] ppid=30620 vsize=0 CPUtime=1136.11 cores=0,2,4,6
/proc/30622/task/30655/stat : 30655 (java) R 30620 30622 29719 0 -1 4203588 49 0 0 0 113581 30 0 0 25 0 2 0 608976306 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4757.96
Current children cumulated vsize (KiB) 0

[startup+1300.6 s]
/proc/loadavg: 8.10 7.96 7.52 7/202 30696
/proc/meminfo: memFree=1367156/32951124 swapFree=67111464/67111528
[pid=30622] ppid=30620 vsize=0 CPUtime=4758.16 cores=0,2,4,6
/proc/30622/stat : 30622 (java) Z 30620 30622 29719 0 -1 4203548 3980347 0 1 0 475098 718 0 0 17 0 2 0 608974622 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/30622/statm: 0 0 0 0 0 0 0
[pid=30622/tid=30655] ppid=30620 vsize=0 CPUtime=1136.31 cores=0,2,4,6
/proc/30622/task/30655/stat : 30655 (java) R 30620 30622 29719 0 -1 4203588 49 0 0 0 113581 50 0 0 25 0 2 0 608976306 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4758.16
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1300.69
CPU time (s): 4758.26
CPU user time (s): 4750.98
CPU system time (s): 7.27389
CPU usage (%): 365.826
Max. virtual memory (cumulated for all children) (KiB): 15720072

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4750.98
system time used= 7.27389
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3980347
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 40582
involuntary context switches= 80112

runsolver used 2.22366 second user time and 4.90425 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-30 20:17:20
IDJOB=3312121
IDBENCH=85042
IDSOLVER=1698
FILE ID=node110/3312121-1304187438
RUNJOBID= node110-1304187437-30592
PBS_JOBID= 13172462
Free space on /tmp= 73284 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT04/industrial/velev/pipe-sat-1-1/12pipe_bug6_q0.used-as.sat04-725.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312121-1304187438/watcher-3312121-1304187438 -o /tmp/evaluation-result-3312121-1304187438/solver-3312121-1304187438 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312121-1304187438.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b16e6cb0e63a3228c47c991012afc8b4
RANDOM SEED=720855433

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30249976 kB
Buffers:       1007980 kB
Cached:        1207564 kB
SwapCached:         64 kB
Active:         489460 kB
Inactive:      1794660 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30249976 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:          198760 kB
Writeback:           0 kB
AnonPages:       67760 kB
Mapped:          19536 kB
Slab:           354084 kB
PageTables:       4700 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   761532 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73280 MiB
End job on node110 at 2011-04-30 20:39:02