Trace number 3311545

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.12 1207.34

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v125-c2662-S1194239878-049.UNKNOWN.cnf
MD5SUMac9c61f9177fd0d9da068d938bec80ff
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables125
Number of clauses2662
Sum of the clauses size13310
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52662
Number of clauses of size over 50

Solver Data 

0.10/0.27	06:12 INFO : Reading from input HOME/instance-3311545-1307657171.cnf
0.37/0.44	Executor set job limit to 1000000
0.37/0.44	Executor set job limit to 1000000
0.37/0.44	Executor set job limit to 1000000
0.37/0.44	Executor set job limit to 1000000
0.37/0.44	Starting Executor!
0.37/0.44	Starting Executor!
0.37/0.44	Starting Executor!
0.37/0.44	Starting Executor!
0.64/0.59	06:12 INFO : 125 variables remaining out of 125
0.64/0.59	06:12 INFO : 15972 literals remaining out of 15972

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311545-1307657171/watcher-3311545-1307657171 -o /tmp/evaluation-result-3311545-1307657171/solver-3311545-1307657171 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311545-1307657171.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 2/178 25036
/proc/meminfo: memFree=32055704/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=26088 CPUtime=0 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 1412 0 0 0 0 0 0 0 18 0 2 0 955947714 26714112 885 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 6522 885 678 9 0 381 0
[pid=25036/tid=25045] ppid=25034 vsize=26088 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) S 25034 25036 21841 0 -1 4202560 56 0 0 0 0 0 0 0 20 0 2 0 955947715 26714112 885 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260015472263 0 2147483391 4096 0 18446744071699199166 0 0 -1 3 0 0 0

[startup+0.082228 s]
/proc/loadavg: 2.02 2.01 2.00 2/178 25036
/proc/meminfo: memFree=32055704/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15676468 CPUtime=0.08 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 5354 0 1 0 8 0 0 0 18 0 18 0 955947714 16052703232 4778 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3919117 4779 2107 9 0 3909836 0
[pid=25036/tid=25045] ppid=25034 vsize=15676468 CPUtime=0.06 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) R 25034 25036 21841 0 -1 4202560 3211 0 1 0 6 0 0 0 18 0 18 0 955947715 16052703232 4779 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 47090542906195 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 15676468

[startup+0.101251 s]
/proc/loadavg: 2.02 2.01 2.00 2/178 25036
/proc/meminfo: memFree=32055704/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15676468 CPUtime=0.09 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 5492 0 1 0 9 0 0 0 18 0 18 0 955947714 16052703232 4915 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3919117 4915 2116 9 0 3909836 0
[pid=25036/tid=25045] ppid=25034 vsize=15676468 CPUtime=0.07 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) D 25034 25036 21841 0 -1 4202560 3338 0 1 0 7 0 0 0 18 0 18 0 955947715 16052703232 4915 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032222667 0 4 0 16800975 18446744071562234166 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15676468

[startup+0.300177 s]
/proc/loadavg: 2.02 2.01 2.00 2/178 25036
/proc/meminfo: memFree=32055704/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15676468 CPUtime=0.17 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 6136 0 1 0 15 2 0 0 18 0 18 0 955947714 16052703232 5527 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3919117 5528 2174 9 0 3909836 0
[pid=25036/tid=25045] ppid=25034 vsize=15676468 CPUtime=0.12 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) R 25034 25036 21841 0 -1 4202560 3846 0 1 0 11 1 0 0 18 0 18 0 955947715 16052703232 5528 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505511518 0 4 0 16800975 0 0 0 -1 3 0 0 6
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 15676468

[startup+0.701058 s]
/proc/loadavg: 2.02 2.01 2.00 2/178 25036
/proc/meminfo: memFree=32055704/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15700588 CPUtime=1.27 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 23169 0 1 0 123 4 0 0 18 0 22 0 955947714 16077402112 18342 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3925147 18342 2255 9 0 3915866 0
[pid=25036/tid=25045] ppid=25034 vsize=15700588 CPUtime=0.42 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) S 25034 25036 21841 0 -1 4202560 7483 0 1 0 40 2 0 0 19 0 22 0 955947715 16077402112 18342 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 7
Current children cumulated CPU time (s) 1.27
Current children cumulated vsize (KiB) 15700588

[startup+1.50091 s]
/proc/loadavg: 2.02 2.01 2.00 15/220 25078
/proc/meminfo: memFree=31837748/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15703764 CPUtime=4.37 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 57668 0 1 0 428 9 0 0 18 0 22 0 955947714 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3925941 49473 2277 9 0 3916660 0
[pid=25036/tid=25045] ppid=25034 vsize=15703764 CPUtime=0.42 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) S 25034 25036 21841 0 -1 4202560 7483 0 1 0 40 2 0 0 19 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 7
[pid=25036/tid=25047] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25047/stat : 25047 (java) S 25034 25036 21841 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25048] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25048/stat : 25048 (java) S 25034 25036 21841 0 -1 4202560 397 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25049] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25049/stat : 25049 (java) S 25034 25036 21841 0 -1 4202560 304 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25050] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25050/stat : 25050 (java) S 25034 25036 21841 0 -1 4202560 676 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25051] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25051/stat : 25051 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25052] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25052/stat : 25052 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25053] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25053/stat : 25053 (java) R 25034 25036 21841 0 -1 4202560 399 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=25036/tid=25054] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25054/stat : 25054 (java) S 25034 25036 21841 0 -1 4202560 359 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25058] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25058/stat : 25058 (java) S 25034 25036 21841 0 -1 4202560 11 0 0 0 0 0 0 0 15 0 22 0 955947716 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25059] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25059/stat : 25059 (java) S 25034 25036 21841 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 955947717 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25060] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25060/stat : 25060 (java) S 25034 25036 21841 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 955947717 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25066] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25066/stat : 25066 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 955947719 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25067] ppid=25034 vsize=15703764 CPUtime=0.93 cores=1,3,5,7
/proc/25036/task/25067/stat : 25067 (java) S 25034 25036 21841 0 -1 4202560 5497 0 0 0 93 0 0 0 17 0 22 0 955947719 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25068] ppid=25034 vsize=15703764 CPUtime=0.88 cores=1,3,5,7
/proc/25036/task/25068/stat : 25068 (java) S 25034 25036 21841 0 -1 4202560 13096 0 0 0 87 1 0 0 15 0 22 0 955947719 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25069] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25069/stat : 25069 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 955947719 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25070] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25070/stat : 25070 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 955947719 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25071] ppid=25034 vsize=15703764 CPUtime=0.83 cores=1,3,5,7
/proc/25036/task/25071/stat : 25071 (java) R 25034 25036 21841 0 -1 4202560 12930 0 0 0 82 1 0 0 19 0 22 0 955947758 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505739345 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=25036/tid=25072] ppid=25034 vsize=15703764 CPUtime=0.21 cores=1,3,5,7
/proc/25036/task/25072/stat : 25072 (java) R 25034 25036 21841 0 -1 4202560 862 0 0 0 21 0 0 0 18 0 22 0 955947758 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505739290 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=25036/tid=25073] ppid=25034 vsize=15703764 CPUtime=0.19 cores=1,3,5,7
/proc/25036/task/25073/stat : 25073 (java) R 25034 25036 21841 0 -1 4202560 510 0 0 0 19 0 0 0 17 0 22 0 955947759 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912506025945 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=25036/tid=25074] ppid=25034 vsize=15703764 CPUtime=0.83 cores=1,3,5,7
/proc/25036/task/25074/stat : 25074 (java) R 25034 25036 21841 0 -1 4202560 13712 0 0 0 82 1 0 0 16 0 22 0 955947759 16080654336 49473 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505800102 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4.37
Current children cumulated vsize (KiB) 15703764

[startup+3.10162 s]
/proc/loadavg: 2.50 2.11 2.03 10/220 25078
/proc/meminfo: memFree=31651528/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15703764 CPUtime=10.72 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 95062 0 1 0 1060 12 0 0 18 0 22 0 955947714 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3925941 85198 2277 9 0 3916660 0
[pid=25036/tid=25045] ppid=25034 vsize=15703764 CPUtime=0.42 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) S 25034 25036 21841 0 -1 4202560 7483 0 1 0 40 2 0 0 19 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 7
[pid=25036/tid=25047] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25047/stat : 25047 (java) S 25034 25036 21841 0 -1 4202560 249 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25048] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25048/stat : 25048 (java) S 25034 25036 21841 0 -1 4202560 1062 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25049] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25049/stat : 25049 (java) S 25034 25036 21841 0 -1 4202560 459 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25050] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25050/stat : 25050 (java) S 25034 25036 21841 0 -1 4202560 1218 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25051] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25051/stat : 25051 (java) S 25034 25036 21841 0 -1 4202560 864 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25052] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25052/stat : 25052 (java) S 25034 25036 21841 0 -1 4202560 271 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25053] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25053/stat : 25053 (java) S 25034 25036 21841 0 -1 4202560 1386 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25054] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25054/stat : 25054 (java) S 25034 25036 21841 0 -1 4202560 474 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25058] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25058/stat : 25058 (java) S 25034 25036 21841 0 -1 4202560 79 0 0 0 0 0 0 0 15 0 22 0 955947716 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25059] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25059/stat : 25059 (java) S 25034 25036 21841 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 955947717 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25060] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25060/stat : 25060 (java) S 25034 25036 21841 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 955947717 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25066] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25066/stat : 25066 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 955947719 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25067] ppid=25034 vsize=15703764 CPUtime=1.02 cores=1,3,5,7
/proc/25036/task/25067/stat : 25067 (java) S 25034 25036 21841 0 -1 4202560 5507 0 0 0 102 0 0 0 15 0 22 0 955947719 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25068] ppid=25034 vsize=15703764 CPUtime=0.94 cores=1,3,5,7
/proc/25036/task/25068/stat : 25068 (java) S 25034 25036 21841 0 -1 4202560 13115 0 0 0 93 1 0 0 15 0 22 0 955947719 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25069] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25069/stat : 25069 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 955947719 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25070] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25070/stat : 25070 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 955947719 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25071] ppid=25034 vsize=15703764 CPUtime=2.4 cores=1,3,5,7
/proc/25036/task/25071/stat : 25071 (java) R 25034 25036 21841 0 -1 4202560 21156 0 0 0 238 2 0 0 23 0 22 0 955947758 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 18446744073699065949 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=25036/tid=25072] ppid=25034 vsize=15703764 CPUtime=1.71 cores=1,3,5,7
/proc/25036/task/25072/stat : 25072 (java) R 25034 25036 21841 0 -1 4202560 9489 0 0 0 170 1 0 0 20 0 22 0 955947758 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 47090542228343 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=25036/tid=25073] ppid=25034 vsize=15703764 CPUtime=1.72 cores=1,3,5,7
/proc/25036/task/25073/stat : 25073 (java) R 25034 25036 21841 0 -1 4202560 8571 0 0 0 172 0 0 0 20 0 22 0 955947759 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=25036/tid=25074] ppid=25034 vsize=15703764 CPUtime=2.42 cores=1,3,5,7
/proc/25036/task/25074/stat : 25074 (java) R 25034 25036 21841 0 -1 4202560 22294 0 0 0 240 2 0 0 18 0 22 0 955947759 16080654336 85198 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505705072 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 10.72
Current children cumulated vsize (KiB) 15703764

[startup+6.30103 s]
/proc/loadavg: 2.50 2.11 2.03 10/220 25078
/proc/meminfo: memFree=31174500/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15703764 CPUtime=23.48 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 95644 0 1 0 2335 13 0 0 18 0 22 0 955947714 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3925941 76821 2287 9 0 3916660 0
[pid=25036/tid=25045] ppid=25034 vsize=15703764 CPUtime=0.42 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) S 25034 25036 21841 0 -1 4202560 7483 0 1 0 40 2 0 0 19 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 7
[pid=25036/tid=25047] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25047/stat : 25047 (java) S 25034 25036 21841 0 -1 4202560 493 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25048] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25048/stat : 25048 (java) S 25034 25036 21841 0 -1 4202560 1080 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25049] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25049/stat : 25049 (java) S 25034 25036 21841 0 -1 4202560 511 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25050] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25050/stat : 25050 (java) S 25034 25036 21841 0 -1 4202560 1254 0 0 0 0 0 0 0 16 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25051] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25051/stat : 25051 (java) S 25034 25036 21841 0 -1 4202560 915 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25052] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25052/stat : 25052 (java) S 25034 25036 21841 0 -1 4202560 304 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25053] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25053/stat : 25053 (java) S 25034 25036 21841 0 -1 4202560 1463 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25054] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25054/stat : 25054 (java) S 25034 25036 21841 0 -1 4202560 486 0 0 0 0 0 0 0 15 0 22 0 955947715 16080654336 76821 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=25036/tid=25072] ppid=25034 vsize=15703764 CPUtime=1107.93 cores=1,3,5,7
/proc/25036/task/25072/stat : 25072 (java) R 25034 25036 21841 0 -1 4202560 153444 0 0 0 110763 30 0 0 25 0 22 0 955947758 16080654336 87131 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505784270 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=25036/tid=25073] ppid=25034 vsize=15703764 CPUtime=1107.42 cores=1,3,5,7
/proc/25036/task/25073/stat : 25073 (java) R 25034 25036 21841 0 -1 4202560 152310 0 0 0 110714 28 0 0 25 0 22 0 955947759 16080654336 87131 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=25036/tid=25074] ppid=25034 vsize=15703764 CPUtime=1108.85 cores=1,3,5,7
/proc/25036/task/25074/stat : 25074 (java) R 25034 25036 21841 0 -1 4202560 167085 0 0 0 110853 32 0 0 25 0 22 0 955947759 16080654336 87131 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505764814 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4462.03
Current children cumulated vsize (KiB) 15703764

[startup+1182.3 s]
/proc/loadavg: 8.02 7.95 6.36 10/220 25109
/proc/meminfo: memFree=31460388/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15703764 CPUtime=4700.58 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 1153567 0 1 0 469743 315 0 0 18 0 22 0 955947714 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3925941 76240 2297 9 0 3916660 0
[pid=25036/tid=25045] ppid=25034 vsize=15703764 CPUtime=0.42 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) S 25034 25036 21841 0 -1 4202560 7483 0 1 0 40 2 0 0 19 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 7
[pid=25036/tid=25047] ppid=25034 vsize=15703764 CPUtime=3.27 cores=1,3,5,7
/proc/25036/task/25047/stat : 25047 (java) S 25034 25036 21841 0 -1 4202560 58747 0 0 0 313 14 0 0 15 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25048] ppid=25034 vsize=15703764 CPUtime=3.21 cores=1,3,5,7
/proc/25036/task/25048/stat : 25048 (java) S 25034 25036 21841 0 -1 4202560 58048 0 0 0 306 15 0 0 16 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25049] ppid=25034 vsize=15703764 CPUtime=3.21 cores=1,3,5,7
/proc/25036/task/25049/stat : 25049 (java) S 25034 25036 21841 0 -1 4202560 57697 0 0 0 307 14 0 0 15 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25050] ppid=25034 vsize=15703764 CPUtime=3.16 cores=1,3,5,7
/proc/25036/task/25050/stat : 25050 (java) S 25034 25036 21841 0 -1 4202560 58933 0 0 0 300 16 0 0 15 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25051] ppid=25034 vsize=15703764 CPUtime=3.16 cores=1,3,5,7
/proc/25036/task/25051/stat : 25051 (java) S 25034 25036 21841 0 -1 4202560 58310 0 0 0 302 14 0 0 15 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25052] ppid=25034 vsize=15703764 CPUtime=3.24 cores=1,3,5,7
/proc/25036/task/25052/stat : 25052 (java) S 25034 25036 21841 0 -1 4202560 55474 0 0 0 308 16 0 0 15 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25053] ppid=25034 vsize=15703764 CPUtime=3.33 cores=1,3,5,7
/proc/25036/task/25053/stat : 25053 (java) S 25034 25036 21841 0 -1 4202560 60330 0 0 0 318 15 0 0 15 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25054] ppid=25034 vsize=15703764 CPUtime=3.3 cores=1,3,5,7
/proc/25036/task/25054/stat : 25054 (java) S 25034 25036 21841 0 -1 4202560 59833 0 0 0 312 18 0 0 15 0 22 0 955947715 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25058] ppid=25034 vsize=15703764 CPUtime=2.12 cores=1,3,5,7
/proc/25036/task/25058/stat : 25058 (java) S 25034 25036 21841 0 -1 4202560 2770 0 0 0 157 55 0 0 15 0 22 0 955947716 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25059] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25059/stat : 25059 (java) S 25034 25036 21841 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 955947717 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25060] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25060/stat : 25060 (java) S 25034 25036 21841 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 955947717 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25066] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25066/stat : 25066 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 955947719 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25067] ppid=25034 vsize=15703764 CPUtime=1.12 cores=1,3,5,7
/proc/25036/task/25067/stat : 25067 (java) S 25034 25036 21841 0 -1 4202560 5527 0 0 0 112 0 0 0 15 0 22 0 955947719 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25068] ppid=25034 vsize=15703764 CPUtime=1.05 cores=1,3,5,7
/proc/25036/task/25068/stat : 25068 (java) S 25034 25036 21841 0 -1 4202560 13144 0 0 0 104 1 0 0 15 0 22 0 955947719 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25069] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25069/stat : 25069 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 955947719 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25070] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25070/stat : 25070 (java) S 25034 25036 21841 0 -1 4202560 63 0 0 0 0 0 0 0 15 0 22 0 955947719 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25071] ppid=25034 vsize=15703764 CPUtime=1167.75 cores=1,3,5,7
/proc/25036/task/25071/stat : 25071 (java) R 25034 25036 21841 0 -1 4202560 168937 0 0 0 116743 32 0 0 25 0 22 0 955947758 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505794744 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=25036/tid=25072] ppid=25034 vsize=15703764 CPUtime=1167.25 cores=1,3,5,7
/proc/25036/task/25072/stat : 25072 (java) R 25034 25036 21841 0 -1 4202560 157971 0 0 0 116694 31 0 0 25 0 22 0 955947758 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 47090542228642 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=25036/tid=25073] ppid=25034 vsize=15703764 CPUtime=1166.62 cores=1,3,5,7
/proc/25036/task/25073/stat : 25073 (java) R 25034 25036 21841 0 -1 4202560 157111 0 0 0 116632 30 0 0 25 0 22 0 955947759 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505366262 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=25036/tid=25074] ppid=25034 vsize=15703764 CPUtime=1168.21 cores=1,3,5,7
/proc/25036/task/25074/stat : 25074 (java) R 25034 25036 21841 0 -1 4202560 171805 0 0 0 116788 33 0 0 25 0 22 0 955947759 16080654336 76240 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505739131 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4700.58
Current children cumulated vsize (KiB) 15703764



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.3 s]
/proc/loadavg: 8.02 7.95 6.41 9/220 25110
/proc/meminfo: memFree=31488532/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15703764 CPUtime=4800.03 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 1175979 0 1 0 479680 323 0 0 18 0 22 0 955947714 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3925941 72164 2297 9 0 3916660 0
[pid=25036/tid=25045] ppid=25034 vsize=15703764 CPUtime=0.42 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) S 25034 25036 21841 0 -1 4202560 7483 0 1 0 40 2 0 0 19 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 7
[pid=25036/tid=25047] ppid=25034 vsize=15703764 CPUtime=3.33 cores=1,3,5,7
/proc/25036/task/25047/stat : 25047 (java) S 25034 25036 21841 0 -1 4202560 59648 0 0 0 318 15 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25048] ppid=25034 vsize=15703764 CPUtime=3.28 cores=1,3,5,7
/proc/25036/task/25048/stat : 25048 (java) S 25034 25036 21841 0 -1 4202560 59528 0 0 0 312 16 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25049] ppid=25034 vsize=15703764 CPUtime=3.28 cores=1,3,5,7
/proc/25036/task/25049/stat : 25049 (java) S 25034 25036 21841 0 -1 4202560 58903 0 0 0 314 14 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25050] ppid=25034 vsize=15703764 CPUtime=3.23 cores=1,3,5,7
/proc/25036/task/25050/stat : 25050 (java) S 25034 25036 21841 0 -1 4202560 60428 0 0 0 307 16 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25051] ppid=25034 vsize=15703764 CPUtime=3.23 cores=1,3,5,7
/proc/25036/task/25051/stat : 25051 (java) S 25034 25036 21841 0 -1 4202560 59275 0 0 0 309 14 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25052] ppid=25034 vsize=15703764 CPUtime=3.31 cores=1,3,5,7
/proc/25036/task/25052/stat : 25052 (java) S 25034 25036 21841 0 -1 4202560 56605 0 0 0 315 16 0 0 16 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25053] ppid=25034 vsize=15703764 CPUtime=3.4 cores=1,3,5,7
/proc/25036/task/25053/stat : 25053 (java) S 25034 25036 21841 0 -1 4202560 61500 0 0 0 325 15 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25054] ppid=25034 vsize=15703764 CPUtime=3.36 cores=1,3,5,7
/proc/25036/task/25054/stat : 25054 (java) S 25034 25036 21841 0 -1 4202560 60976 0 0 0 318 18 0 0 16 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25058] ppid=25034 vsize=15703764 CPUtime=2.16 cores=1,3,5,7
/proc/25036/task/25058/stat : 25058 (java) S 25034 25036 21841 0 -1 4202560 2822 0 0 0 160 56 0 0 15 0 22 0 955947716 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25059] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25059/stat : 25059 (java) S 25034 25036 21841 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 955947717 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25060] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25060/stat : 25060 (java) S 25034 25036 21841 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 955947717 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25066] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25066/stat : 25066 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25067] ppid=25034 vsize=15703764 CPUtime=1.12 cores=1,3,5,7
/proc/25036/task/25067/stat : 25067 (java) S 25034 25036 21841 0 -1 4202560 5527 0 0 0 112 0 0 0 15 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25068] ppid=25034 vsize=15703764 CPUtime=1.05 cores=1,3,5,7
/proc/25036/task/25068/stat : 25068 (java) S 25034 25036 21841 0 -1 4202560 13144 0 0 0 104 1 0 0 15 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25069] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25069/stat : 25069 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25070] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25070/stat : 25070 (java) S 25034 25036 21841 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25071] ppid=25034 vsize=15703764 CPUtime=1192.45 cores=1,3,5,7
/proc/25036/task/25071/stat : 25071 (java) R 25034 25036 21841 0 -1 4202560 172326 0 0 0 119213 32 0 0 25 0 22 0 955947758 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505652437 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=25036/tid=25072] ppid=25034 vsize=15703764 CPUtime=1191.98 cores=1,3,5,7
/proc/25036/task/25072/stat : 25072 (java) R 25034 25036 21841 0 -1 4202560 161117 0 0 0 119166 32 0 0 25 0 22 0 955947758 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 18446744073699065894 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=25036/tid=25073] ppid=25034 vsize=15703764 CPUtime=1191.37 cores=1,3,5,7
/proc/25036/task/25073/stat : 25073 (java) R 25034 25036 21841 0 -1 4202560 160403 0 0 0 119106 31 0 0 25 0 22 0 955947759 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505808464 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=25036/tid=25074] ppid=25034 vsize=15703764 CPUtime=1192.9 cores=1,3,5,7
/proc/25036/task/25074/stat : 25074 (java) R 25034 25036 21841 0 -1 4202560 174845 0 0 0 119256 34 0 0 25 0 22 0 955947759 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 18446744073699065971 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.03
Current children cumulated vsize (KiB) 15703764

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.3 s]
/proc/loadavg: 8.02 7.95 6.41 9/220 25110
/proc/meminfo: memFree=31488532/32951124 swapFree=67056304/67111528
[pid=25036] ppid=25034 vsize=15703764 CPUtime=4800.03 cores=1,3,5,7
/proc/25036/stat : 25036 (java) S 25034 25036 21841 0 -1 4202496 1175979 0 1 0 479680 323 0 0 18 0 22 0 955947714 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/25036/statm: 3925941 72164 2297 9 0 3916660 0
[pid=25036/tid=25045] ppid=25034 vsize=15703764 CPUtime=0.42 cores=1,3,5,7
/proc/25036/task/25045/stat : 25045 (java) S 25034 25036 21841 0 -1 4202560 7483 0 1 0 40 2 0 0 19 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 7
[pid=25036/tid=25047] ppid=25034 vsize=15703764 CPUtime=3.33 cores=1,3,5,7
/proc/25036/task/25047/stat : 25047 (java) S 25034 25036 21841 0 -1 4202560 59648 0 0 0 318 15 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25048] ppid=25034 vsize=15703764 CPUtime=3.28 cores=1,3,5,7
/proc/25036/task/25048/stat : 25048 (java) S 25034 25036 21841 0 -1 4202560 59528 0 0 0 312 16 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25049] ppid=25034 vsize=15703764 CPUtime=3.28 cores=1,3,5,7
/proc/25036/task/25049/stat : 25049 (java) S 25034 25036 21841 0 -1 4202560 58903 0 0 0 314 14 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25050] ppid=25034 vsize=15703764 CPUtime=3.23 cores=1,3,5,7
/proc/25036/task/25050/stat : 25050 (java) S 25034 25036 21841 0 -1 4202560 60428 0 0 0 307 16 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25051] ppid=25034 vsize=15703764 CPUtime=3.23 cores=1,3,5,7
/proc/25036/task/25051/stat : 25051 (java) S 25034 25036 21841 0 -1 4202560 59275 0 0 0 309 14 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25052] ppid=25034 vsize=15703764 CPUtime=3.31 cores=1,3,5,7
/proc/25036/task/25052/stat : 25052 (java) S 25034 25036 21841 0 -1 4202560 56605 0 0 0 315 16 0 0 16 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25053] ppid=25034 vsize=15703764 CPUtime=3.4 cores=1,3,5,7
/proc/25036/task/25053/stat : 25053 (java) S 25034 25036 21841 0 -1 4202560 61500 0 0 0 325 15 0 0 15 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=25036/tid=25054] ppid=25034 vsize=15703764 CPUtime=3.36 cores=1,3,5,7
/proc/25036/task/25054/stat : 25054 (java) S 25034 25036 21841 0 -1 4202560 60976 0 0 0 318 18 0 0 16 0 22 0 955947715 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25058] ppid=25034 vsize=15703764 CPUtime=2.16 cores=1,3,5,7
/proc/25036/task/25058/stat : 25058 (java) S 25034 25036 21841 0 -1 4202560 2822 0 0 0 160 56 0 0 15 0 22 0 955947716 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25059] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25059/stat : 25059 (java) S 25034 25036 21841 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 955947717 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25060] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25060/stat : 25060 (java) S 25034 25036 21841 0 -1 4202560 9 0 0 0 0 0 0 0 17 0 22 0 955947717 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25066] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25066/stat : 25066 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25067] ppid=25034 vsize=15703764 CPUtime=1.12 cores=1,3,5,7
/proc/25036/task/25067/stat : 25067 (java) S 25034 25036 21841 0 -1 4202560 5527 0 0 0 112 0 0 0 15 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25068] ppid=25034 vsize=15703764 CPUtime=1.05 cores=1,3,5,7
/proc/25036/task/25068/stat : 25068 (java) S 25034 25036 21841 0 -1 4202560 13144 0 0 0 104 1 0 0 15 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=25036/tid=25069] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25069/stat : 25069 (java) S 25034 25036 21841 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=25036/tid=25070] ppid=25034 vsize=15703764 CPUtime=0 cores=1,3,5,7
/proc/25036/task/25070/stat : 25070 (java) S 25034 25036 21841 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 955947719 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=25036/tid=25071] ppid=25034 vsize=15703764 CPUtime=1192.45 cores=1,3,5,7
/proc/25036/task/25071/stat : 25071 (java) R 25034 25036 21841 0 -1 4202560 172326 0 0 0 119213 32 0 0 25 0 22 0 955947758 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505652437 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=25036/tid=25072] ppid=25034 vsize=15703764 CPUtime=1191.98 cores=1,3,5,7
/proc/25036/task/25072/stat : 25072 (java) R 25034 25036 21841 0 -1 4202560 161117 0 0 0 119166 32 0 0 25 0 22 0 955947758 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 18446744073699065894 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=25036/tid=25073] ppid=25034 vsize=15703764 CPUtime=1191.37 cores=1,3,5,7
/proc/25036/task/25073/stat : 25073 (java) R 25034 25036 21841 0 -1 4202560 160403 0 0 0 119106 31 0 0 25 0 22 0 955947759 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 46912505808464 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=25036/tid=25074] ppid=25034 vsize=15703764 CPUtime=1192.9 cores=1,3,5,7
/proc/25036/task/25074/stat : 25074 (java) R 25034 25036 21841 0 -1 4202560 174845 0 0 0 119256 34 0 0 25 0 22 0 955947759 16080654336 72164 33554432000 1073741824 1073778376 140736730225056 18446744073709551615 18446744073699065971 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.03
Current children cumulated vsize (KiB) 15703764

Child status: 143
Real time (s): 1207.34
CPU time (s): 4800.12
CPU user time (s): 4796.87
CPU system time (s): 3.24451
CPU usage (%): 397.578
Max. virtual memory (cumulated for all children) (KiB): 15703764

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.87
system time used= 3.24451
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1176007
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 321425
involuntary context switches= 175874

runsolver used 2.00769 second user time and 4.6193 second system time

The end

Launcher Data 

Begin job on node110 at 2011-06-10 00:06:11
IDJOB=3311545
IDBENCH=82930
IDSOLVER=1698
FILE ID=node110/3311545-1307657171
RUNJOBID= node110-1307657171-25008
PBS_JOBID= 13549381
Free space on /tmp= 74168 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v125-c2662-S1194239878-049.UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311545-1307657171/watcher-3311545-1307657171 -o /tmp/evaluation-result-3311545-1307657171/solver-3311545-1307657171 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311545-1307657171.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac9c61f9177fd0d9da068d938bec80ff
RANDOM SEED=1606293558

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32056768 kB
Buffers:        237536 kB
Cached:         406900 kB
SwapCached:       8464 kB
Active:         334160 kB
Inactive:       329212 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32056768 kB
SwapTotal:    67111528 kB
SwapFree:     67056304 kB
Dirty:            3564 kB
Writeback:          60 kB
AnonPages:       16748 kB
Mapped:          13188 kB
Slab:           165744 kB
PageTables:       4672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   192956 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74168 MiB
End job on node110 at 2011-06-10 00:26:21