Trace number 3311748

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.27 1207.33

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-17_279.cnf
MD5SUMd2562f4e152a54a992ab300a2bacfba9
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables279
Number of clauses21616
Sum of the clauses size96978
Maximum clause length17
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 319321
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52295

Solver Data 

0.09/0.12	36:52 INFO : Reading from input HOME/instance-3311748-1304185012.cnf
0.62/0.40	Executor set job limit to 1000000
0.62/0.40	Executor set job limit to 1000000
0.62/0.40	Executor set job limit to 1000000
0.62/0.40	Executor set job limit to 1000000
0.62/0.40	Starting Executor!
0.62/0.40	Starting Executor!
0.62/0.40	Starting Executor!
0.62/0.40	Starting Executor!
1.29/0.79	36:53 INFO : 279 variables remaining out of 279
1.29/0.79	36:53 INFO : 118594 literals remaining out of 118594

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311748-1304185012/watcher-3311748-1304185012 -o /tmp/evaluation-result-3311748-1304185012/solver-3311748-1304185012 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311748-1304185012.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 7.88 7.93 5/198 30351
/proc/meminfo: memFree=30191472/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=23028 CPUtime=0 cores=1,3,5,7
/proc/30351/stat : 30351 (java) R 30349 30351 29719 0 -1 4202496 981 0 0 0 0 0 0 0 25 0 1 0 608731793 23580672 468 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260015433493 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/30351/statm: 5757 481 368 9 0 124 0

[startup+0.069745 s]
/proc/loadavg: 8.10 7.88 7.93 5/198 30351
/proc/meminfo: memFree=30191472/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15609780 CPUtime=0.05 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 4364 0 1 0 5 0 0 0 25 0 18 0 608731793 15984414720 3804 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3902445 3804 1778 9 0 3893164 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 15609780

[startup+0.100727 s]
/proc/loadavg: 8.10 7.88 7.93 5/198 30351
/proc/meminfo: memFree=30191472/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15741996 CPUtime=0.09 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 5561 0 1 0 9 0 0 0 25 0 18 0 608731793 16119803904 4982 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3935499 4982 2116 9 0 3926218 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15741996

[startup+0.300658 s]
/proc/loadavg: 8.10 7.88 7.93 5/198 30351
/proc/meminfo: memFree=30191472/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15747332 CPUtime=0.51 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 14347 0 1 0 49 2 0 0 25 0 18 0 608731793 16125267968 12563 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3936833 12570 2207 9 0 3927552 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15747332

[startup+0.700584 s]
/proc/loadavg: 8.10 7.88 7.93 5/198 30351
/proc/meminfo: memFree=30191472/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15751444 CPUtime=1.29 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 35413 0 1 0 124 5 0 0 25 0 22 0 608731793 16129478656 32333 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3937861 32333 2248 9 0 3928580 0
Current children cumulated CPU time (s) 1.29
Current children cumulated vsize (KiB) 15751444

[startup+1.50144 s]
/proc/loadavg: 8.10 7.88 7.93 5/220 30373
/proc/meminfo: memFree=30041628/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15752632 CPUtime=3.7 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 53284 0 1 0 362 8 0 0 25 0 22 0 608731793 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3938158 47590 2275 9 0 3928877 0
[pid=30351/tid=30353] ppid=30349 vsize=15752632 CPUtime=0.77 cores=1,3,5,7
/proc/30351/task/30353/stat : 30353 (java) S 30349 30351 29719 0 -1 4202560 26978 0 1 0 73 4 0 0 20 0 22 0 608731794 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30354] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30354/stat : 30354 (java) S 30349 30351 29719 0 -1 4202560 460 0 0 0 0 0 0 0 15 0 22 0 608731795 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30355] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30355/stat : 30355 (java) S 30349 30351 29719 0 -1 4202560 867 0 0 0 0 0 0 0 15 0 22 0 608731795 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30356] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30356/stat : 30356 (java) S 30349 30351 29719 0 -1 4202560 1757 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30357] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30357/stat : 30357 (java) S 30349 30351 29719 0 -1 4202560 190 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30358] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30358/stat : 30358 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 608731795 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30359] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30359/stat : 30359 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30360] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30360/stat : 30360 (java) S 30349 30351 29719 0 -1 4202560 955 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30361] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30361/stat : 30361 (java) S 30349 30351 29719 0 -1 4202560 1508 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30362] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30362/stat : 30362 (java) S 30349 30351 29719 0 -1 4202560 10 0 0 0 0 0 0 0 15 0 22 0 608731796 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30363] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30363/stat : 30363 (java) S 30349 30351 29719 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30364] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30364/stat : 30364 (java) S 30349 30351 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30365] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30365/stat : 30365 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30366] ppid=30349 vsize=15752632 CPUtime=0.52 cores=1,3,5,7
/proc/30351/task/30366/stat : 30366 (java) R 30349 30351 29719 0 -1 4202560 4491 0 0 0 52 0 0 0 24 0 22 0 608731798 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032221877 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=30351/tid=30367] ppid=30349 vsize=15752632 CPUtime=0.7 cores=1,3,5,7
/proc/30351/task/30367/stat : 30367 (java) S 30349 30351 29719 0 -1 4202560 5956 0 0 0 69 1 0 0 16 0 22 0 608731798 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30368] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30368/stat : 30368 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30369] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30369/stat : 30369 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 608731798 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30370] ppid=30349 vsize=15752632 CPUtime=0.41 cores=1,3,5,7
/proc/30351/task/30370/stat : 30370 (java) R 30349 30351 29719 0 -1 4202560 2249 0 0 0 41 0 0 0 16 0 22 0 608731834 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505873247 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=30351/tid=30371] ppid=30349 vsize=15752632 CPUtime=0.31 cores=1,3,5,7
/proc/30351/task/30371/stat : 30371 (java) R 30349 30351 29719 0 -1 4202560 2368 0 0 0 31 0 0 0 16 0 22 0 608731834 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506067368 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=30351/tid=30372] ppid=30349 vsize=15752632 CPUtime=0.45 cores=1,3,5,7
/proc/30351/task/30372/stat : 30372 (java) R 30349 30351 29719 0 -1 4202560 1932 0 0 0 45 0 0 0 16 0 22 0 608731834 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 47992303721419 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=30351/tid=30373] ppid=30349 vsize=15752632 CPUtime=0.45 cores=1,3,5,7
/proc/30351/task/30373/stat : 30373 (java) R 30349 30351 29719 0 -1 4202560 2177 0 0 0 45 0 0 0 16 0 22 0 608731834 16130695168 47590 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506028345 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.7
Current children cumulated vsize (KiB) 15752632

[startup+3.10114 s]
/proc/loadavg: 8.33 7.94 7.95 10/220 30373
/proc/meminfo: memFree=29934532/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15752632 CPUtime=10.08 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 97381 0 1 0 993 15 0 0 25 0 22 0 608731793 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3938158 90657 2285 9 0 3928877 0
[pid=30351/tid=30353] ppid=30349 vsize=15752632 CPUtime=0.77 cores=1,3,5,7
/proc/30351/task/30353/stat : 30353 (java) S 30349 30351 29719 0 -1 4202560 26978 0 1 0 73 4 0 0 20 0 22 0 608731794 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30354] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30354/stat : 30354 (java) S 30349 30351 29719 0 -1 4202560 3430 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30355] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30355/stat : 30355 (java) S 30349 30351 29719 0 -1 4202560 3062 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30356] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30356/stat : 30356 (java) S 30349 30351 29719 0 -1 4202560 4782 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30357] ppid=30349 vsize=15752632 CPUtime=0.01 cores=1,3,5,7
/proc/30351/task/30357/stat : 30357 (java) S 30349 30351 29719 0 -1 4202560 3363 0 0 0 1 0 0 0 16 0 22 0 608731795 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30358] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30358/stat : 30358 (java) S 30349 30351 29719 0 -1 4202560 409 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30359] ppid=30349 vsize=15752632 CPUtime=0.01 cores=1,3,5,7
/proc/30351/task/30359/stat : 30359 (java) S 30349 30351 29719 0 -1 4202560 3753 0 0 0 1 0 0 0 15 0 22 0 608731795 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30360] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30360/stat : 30360 (java) S 30349 30351 29719 0 -1 4202560 1909 0 0 0 0 0 0 0 15 0 22 0 608731795 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30361] ppid=30349 vsize=15752632 CPUtime=0.01 cores=1,3,5,7
/proc/30351/task/30361/stat : 30361 (java) S 30349 30351 29719 0 -1 4202560 5272 0 0 0 1 0 0 0 15 0 22 0 608731795 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30362] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30362/stat : 30362 (java) S 30349 30351 29719 0 -1 4202560 208 0 0 0 0 0 0 0 15 0 22 0 608731796 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30363] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30363/stat : 30363 (java) S 30349 30351 29719 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30364] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30364/stat : 30364 (java) S 30349 30351 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30365] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30365/stat : 30365 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30366] ppid=30349 vsize=15752632 CPUtime=0.52 cores=1,3,5,7
/proc/30351/task/30366/stat : 30366 (java) R 30349 30351 29719 0 -1 4202560 4494 0 0 0 52 0 0 0 20 0 22 0 608731798 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 47992303451745 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=30351/tid=30367] ppid=30349 vsize=15752632 CPUtime=0.91 cores=1,3,5,7
/proc/30351/task/30367/stat : 30367 (java) S 30349 30351 29719 0 -1 4202560 7013 0 0 0 90 1 0 0 16 0 22 0 608731798 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30368] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30368/stat : 30368 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30369] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30369/stat : 30369 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 608731798 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30370] ppid=30349 vsize=15752632 CPUtime=1.95 cores=1,3,5,7
/proc/30351/task/30370/stat : 30370 (java) R 30349 30351 29719 0 -1 4202560 8154 0 0 0 194 1 0 0 17 0 22 0 608731834 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505813336 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=30351/tid=30371] ppid=30349 vsize=15752632 CPUtime=1.7 cores=1,3,5,7
/proc/30351/task/30371/stat : 30371 (java) R 30349 30351 29719 0 -1 4202560 6910 0 0 0 170 0 0 0 17 0 22 0 608731834 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505724422 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=30351/tid=30372] ppid=30349 vsize=15752632 CPUtime=2.02 cores=1,3,5,7
/proc/30351/task/30372/stat : 30372 (java) R 30349 30351 29719 0 -1 4202560 7887 0 0 0 202 0 0 0 17 0 22 0 608731834 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506060199 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=30351/tid=30373] ppid=30349 vsize=15752632 CPUtime=2.02 cores=1,3,5,7
/proc/30351/task/30373/stat : 30373 (java) R 30349 30351 29719 0 -1 4202560 8373 0 0 0 202 0 0 0 17 0 22 0 608731834 16130695168 90657 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505931334 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 10.08
Current children cumulated vsize (KiB) 15752632

[startup+6.30155 s]
/proc/loadavg: 8.33 7.94 7.95 9/220 30373
/proc/meminfo: memFree=29581960/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15752632 CPUtime=22.85 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 253979 0 1 0 2254 31 0 0 25 0 22 0 608731793 16130695168 246398 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3938158 246402 2285 9 0 3928877 0
[pid=30351/tid=30353] ppid=30349 vsize=15752632 CPUtime=0.77 cores=1,3,5,7
/proc/30351/task/30353/stat : 30353 (java) S 30349 30351 29719 0 -1 4202560 26978 0 1 0 73 4 0 0 20 0 22 0 608731794 16130695168 246403 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30354] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30354/stat : 30354 (java) S 30349 30351 29719 0 -1 4202560 4026 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 246405 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30355] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30355/stat : 30355 (java) S 30349 30351 29719 0 -1 4202560 3062 0 0 0 0 0 0 0 15 0 22 0 608731795 16130695168 246407 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30356] ppid=30349 vsize=15752632 CPUtime=0.02 cores=1,3,5,7
/proc/30351/task/30356/stat : 30356 (java) S 30349 30351 29719 0 -1 4202560 5809 0 0 0 1 1 0 0 15 0 22 0 608731795 16130695168 246409 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30357] ppid=30349 vsize=15752632 CPUtime=0.01 cores=1,3,5,7
/proc/30351/task/30357/stat : 30357 (java) S 30349 30351 29719 0 -1 4202560 4080 0 0 0 1 0 0 0 16 0 22 0 608731795 16130695168 246410 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30358] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30358/stat : 30358 (java) S 30349 30351 29719 0 -1 4202560 1089 0 0 0 0 0 0 0 16 0 22 0 608731795 16130695168 246412 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30359] ppid=30349 vsize=15752632 CPUtime=0.01 cores=1,3,5,7
/proc/30351/task/30359/stat : 30359 (java) S 30349 30351 29719 0 -1 4202560 5540 0 0 0 1 0 0 0 16 0 22 0 608731795 16130695168 246414 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30360] ppid=30349 vsize=15752632 CPUtime=0.01 cores=1,3,5,7
/proc/30351/task/30360/stat : 30360 (java) S 30349 30351 29719 0 -1 4202560 3537 0 0 0 1 0 0 0 15 0 22 0 608731795 16130695168 246416 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30361] ppid=30349 vsize=15752632 CPUtime=0.02 cores=1,3,5,7
/proc/30351/task/30361/stat : 30361 (java) S 30349 30351 29719 0 -1 4202560 6353 0 0 0 1 1 0 0 15 0 22 0 608731795 16130695168 246418 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30362] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30362/stat : 30362 (java) S 30349 30351 29719 0 -1 4202560 461 0 0 0 0 0 0 0 15 0 22 0 608731796 16130695168 246420 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30363] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30363/stat : 30363 (java) S 30349 30351 29719 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 246422 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30364] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30364/stat : 30364 (java) S 30349 30351 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 246424 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30365] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30365/stat : 30365 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 246426 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30366] ppid=30349 vsize=15752632 CPUtime=0.58 cores=1,3,5,7
/proc/30351/task/30366/stat : 30366 (java) S 30349 30351 29719 0 -1 4202560 4501 0 0 0 58 0 0 0 15 0 22 0 608731798 16130695168 246427 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0

################
# More data... #
################

[pid=30351/tid=30371] ppid=30349 vsize=15752632 CPUtime=1106.93 cores=1,3,5,7
/proc/30351/task/30371/stat : 30371 (java) R 30349 30351 29719 0 -1 4202560 275417 0 0 0 110655 38 0 0 25 0 22 0 608731834 16130695168 66639 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505907096 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=30351/tid=30372] ppid=30349 vsize=15752632 CPUtime=1107.71 cores=1,3,5,7
/proc/30351/task/30372/stat : 30372 (java) R 30349 30351 29719 0 -1 4202560 267011 0 0 0 110728 43 0 0 25 0 22 0 608731834 16130695168 66639 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505812990 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=30351/tid=30373] ppid=30349 vsize=15752632 CPUtime=1108.14 cores=1,3,5,7
/proc/30351/task/30373/stat : 30373 (java) R 30349 30351 29719 0 -1 4202560 273367 0 0 0 110775 39 0 0 25 0 22 0 608731834 16130695168 66639 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 18446744073699065904 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4462.24
Current children cumulated vsize (KiB) 15752632

[startup+1182.3 s]
/proc/loadavg: 8.05 8.05 8.00 10/220 30458
/proc/meminfo: memFree=29399088/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15752632 CPUtime=4700.83 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 2198656 0 1 0 469628 455 0 0 25 0 22 0 608731793 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3938158 67952 2298 9 0 3928877 0
[pid=30351/tid=30353] ppid=30349 vsize=15752632 CPUtime=0.77 cores=1,3,5,7
/proc/30351/task/30353/stat : 30353 (java) S 30349 30351 29719 0 -1 4202560 26978 0 1 0 73 4 0 0 20 0 22 0 608731794 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30354] ppid=30349 vsize=15752632 CPUtime=3.45 cores=1,3,5,7
/proc/30351/task/30354/stat : 30354 (java) S 30349 30351 29719 0 -1 4202560 123431 0 0 0 321 24 0 0 15 0 22 0 608731795 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30355] ppid=30349 vsize=15752632 CPUtime=3.55 cores=1,3,5,7
/proc/30351/task/30355/stat : 30355 (java) S 30349 30351 29719 0 -1 4202560 124271 0 0 0 330 25 0 0 15 0 22 0 608731795 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30356] ppid=30349 vsize=15752632 CPUtime=3.49 cores=1,3,5,7
/proc/30351/task/30356/stat : 30356 (java) S 30349 30351 29719 0 -1 4202560 125892 0 0 0 325 24 0 0 15 0 22 0 608731795 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30357] ppid=30349 vsize=15752632 CPUtime=3.65 cores=1,3,5,7
/proc/30351/task/30357/stat : 30357 (java) S 30349 30351 29719 0 -1 4202560 131995 0 0 0 340 25 0 0 15 0 22 0 608731795 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30358] ppid=30349 vsize=15752632 CPUtime=3.52 cores=1,3,5,7
/proc/30351/task/30358/stat : 30358 (java) S 30349 30351 29719 0 -1 4202560 123717 0 0 0 329 23 0 0 15 0 22 0 608731795 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30359] ppid=30349 vsize=15752632 CPUtime=3.44 cores=1,3,5,7
/proc/30351/task/30359/stat : 30359 (java) S 30349 30351 29719 0 -1 4202560 128735 0 0 0 320 24 0 0 15 0 22 0 608731795 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30360] ppid=30349 vsize=15752632 CPUtime=3.52 cores=1,3,5,7
/proc/30351/task/30360/stat : 30360 (java) S 30349 30351 29719 0 -1 4202560 127211 0 0 0 328 24 0 0 15 0 22 0 608731795 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30361] ppid=30349 vsize=15752632 CPUtime=3.59 cores=1,3,5,7
/proc/30351/task/30361/stat : 30361 (java) S 30349 30351 29719 0 -1 4202560 124988 0 0 0 335 24 0 0 15 0 22 0 608731795 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30362] ppid=30349 vsize=15752632 CPUtime=2.23 cores=1,3,5,7
/proc/30351/task/30362/stat : 30362 (java) S 30349 30351 29719 0 -1 4202560 5663 0 0 0 148 75 0 0 15 0 22 0 608731796 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30363] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30363/stat : 30363 (java) S 30349 30351 29719 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30364] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30364/stat : 30364 (java) S 30349 30351 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30365] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30365/stat : 30365 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30366] ppid=30349 vsize=15752632 CPUtime=0.67 cores=1,3,5,7
/proc/30351/task/30366/stat : 30366 (java) S 30349 30351 29719 0 -1 4202560 4530 0 0 0 67 0 0 0 15 0 22 0 608731798 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30367] ppid=30349 vsize=15752632 CPUtime=1.11 cores=1,3,5,7
/proc/30351/task/30367/stat : 30367 (java) S 30349 30351 29719 0 -1 4202560 8361 0 0 0 110 1 0 0 15 0 22 0 608731798 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30368] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30368/stat : 30368 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30369] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30369/stat : 30369 (java) S 30349 30351 29719 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 608731798 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30370] ppid=30349 vsize=15752632 CPUtime=1167.12 cores=1,3,5,7
/proc/30351/task/30370/stat : 30370 (java) R 30349 30351 29719 0 -1 4202560 285944 0 0 0 116666 46 0 0 25 0 22 0 608731834 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505855674 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=30351/tid=30371] ppid=30349 vsize=15752632 CPUtime=1166.28 cores=1,3,5,7
/proc/30351/task/30371/stat : 30371 (java) R 30349 30351 29719 0 -1 4202560 289176 0 0 0 116588 40 0 0 25 0 22 0 608731834 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506029609 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=30351/tid=30372] ppid=30349 vsize=15752632 CPUtime=1166.95 cores=1,3,5,7
/proc/30351/task/30372/stat : 30372 (java) R 30349 30351 29719 0 -1 4202560 279721 0 0 0 116650 45 0 0 25 0 22 0 608731834 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505926254 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=30351/tid=30373] ppid=30349 vsize=15752632 CPUtime=1167.34 cores=1,3,5,7
/proc/30351/task/30373/stat : 30373 (java) R 30349 30351 29719 0 -1 4202560 286594 0 0 0 116692 42 0 0 25 0 22 0 608731834 16130695168 67952 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505813004 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4700.83
Current children cumulated vsize (KiB) 15752632



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.3 s]
/proc/loadavg: 8.10 8.07 8.00 9/220 30459
/proc/meminfo: memFree=29417052/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15752632 CPUtime=4800.23 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 2239527 0 1 0 479559 464 0 0 25 0 22 0 608731793 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3938158 65465 2298 9 0 3928877 0
[pid=30351/tid=30353] ppid=30349 vsize=15752632 CPUtime=0.77 cores=1,3,5,7
/proc/30351/task/30353/stat : 30353 (java) S 30349 30351 29719 0 -1 4202560 26978 0 1 0 73 4 0 0 20 0 22 0 608731794 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30354] ppid=30349 vsize=15752632 CPUtime=3.52 cores=1,3,5,7
/proc/30351/task/30354/stat : 30354 (java) S 30349 30351 29719 0 -1 4202560 126280 0 0 0 327 25 0 0 16 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30355] ppid=30349 vsize=15752632 CPUtime=3.61 cores=1,3,5,7
/proc/30351/task/30355/stat : 30355 (java) S 30349 30351 29719 0 -1 4202560 126669 0 0 0 335 26 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30356] ppid=30349 vsize=15752632 CPUtime=3.55 cores=1,3,5,7
/proc/30351/task/30356/stat : 30356 (java) S 30349 30351 29719 0 -1 4202560 128574 0 0 0 330 25 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30357] ppid=30349 vsize=15752632 CPUtime=3.72 cores=1,3,5,7
/proc/30351/task/30357/stat : 30357 (java) S 30349 30351 29719 0 -1 4202560 135841 0 0 0 347 25 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30358] ppid=30349 vsize=15752632 CPUtime=3.6 cores=1,3,5,7
/proc/30351/task/30358/stat : 30358 (java) S 30349 30351 29719 0 -1 4202560 126941 0 0 0 336 24 0 0 16 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30359] ppid=30349 vsize=15752632 CPUtime=3.5 cores=1,3,5,7
/proc/30351/task/30359/stat : 30359 (java) S 30349 30351 29719 0 -1 4202560 131581 0 0 0 326 24 0 0 16 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30360] ppid=30349 vsize=15752632 CPUtime=3.59 cores=1,3,5,7
/proc/30351/task/30360/stat : 30360 (java) S 30349 30351 29719 0 -1 4202560 130186 0 0 0 334 25 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30361] ppid=30349 vsize=15752632 CPUtime=3.65 cores=1,3,5,7
/proc/30351/task/30361/stat : 30361 (java) S 30349 30351 29719 0 -1 4202560 127946 0 0 0 341 24 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30362] ppid=30349 vsize=15752632 CPUtime=2.29 cores=1,3,5,7
/proc/30351/task/30362/stat : 30362 (java) S 30349 30351 29719 0 -1 4202560 5772 0 0 0 152 77 0 0 15 0 22 0 608731796 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30363] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30363/stat : 30363 (java) S 30349 30351 29719 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30364] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30364/stat : 30364 (java) S 30349 30351 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30365] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30365/stat : 30365 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30366] ppid=30349 vsize=15752632 CPUtime=0.67 cores=1,3,5,7
/proc/30351/task/30366/stat : 30366 (java) S 30349 30351 29719 0 -1 4202560 4530 0 0 0 67 0 0 0 15 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30367] ppid=30349 vsize=15752632 CPUtime=1.11 cores=1,3,5,7
/proc/30351/task/30367/stat : 30367 (java) S 30349 30351 29719 0 -1 4202560 8361 0 0 0 110 1 0 0 15 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30368] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30368/stat : 30368 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30369] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30369/stat : 30369 (java) S 30349 30351 29719 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30370] ppid=30349 vsize=15752632 CPUtime=1191.82 cores=1,3,5,7
/proc/30351/task/30370/stat : 30370 (java) R 30349 30351 29719 0 -1 4202560 290264 0 0 0 119135 47 0 0 25 0 22 0 608731834 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505931461 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=30351/tid=30371] ppid=30349 vsize=15752632 CPUtime=1191.03 cores=1,3,5,7
/proc/30351/task/30371/stat : 30371 (java) R 30349 30351 29719 0 -1 4202560 293258 0 0 0 119062 41 0 0 25 0 22 0 608731834 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506067260 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=30351/tid=30372] ppid=30349 vsize=15752632 CPUtime=1191.61 cores=1,3,5,7
/proc/30351/task/30372/stat : 30372 (java) R 30349 30351 29719 0 -1 4202560 283507 0 0 0 119115 46 0 0 25 0 22 0 608731834 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506025164 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=30351/tid=30373] ppid=30349 vsize=15752632 CPUtime=1192.05 cores=1,3,5,7
/proc/30351/task/30373/stat : 30373 (java) R 30349 30351 29719 0 -1 4202560 291390 0 0 0 119162 43 0 0 25 0 22 0 608731834 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506028345 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 15752632

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.3 s]
/proc/loadavg: 8.10 8.07 8.00 9/220 30459
/proc/meminfo: memFree=29417052/32951124 swapFree=67111464/67111528
[pid=30351] ppid=30349 vsize=15752632 CPUtime=4800.23 cores=1,3,5,7
/proc/30351/stat : 30351 (java) S 30349 30351 29719 0 -1 4202496 2239527 0 1 0 479559 464 0 0 25 0 22 0 608731793 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032198629 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30351/statm: 3938158 65465 2298 9 0 3928877 0
[pid=30351/tid=30353] ppid=30349 vsize=15752632 CPUtime=0.77 cores=1,3,5,7
/proc/30351/task/30353/stat : 30353 (java) S 30349 30351 29719 0 -1 4202560 26978 0 1 0 73 4 0 0 20 0 22 0 608731794 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30354] ppid=30349 vsize=15752632 CPUtime=3.52 cores=1,3,5,7
/proc/30351/task/30354/stat : 30354 (java) S 30349 30351 29719 0 -1 4202560 126280 0 0 0 327 25 0 0 16 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30355] ppid=30349 vsize=15752632 CPUtime=3.61 cores=1,3,5,7
/proc/30351/task/30355/stat : 30355 (java) S 30349 30351 29719 0 -1 4202560 126669 0 0 0 335 26 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30356] ppid=30349 vsize=15752632 CPUtime=3.55 cores=1,3,5,7
/proc/30351/task/30356/stat : 30356 (java) S 30349 30351 29719 0 -1 4202560 128574 0 0 0 330 25 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30357] ppid=30349 vsize=15752632 CPUtime=3.72 cores=1,3,5,7
/proc/30351/task/30357/stat : 30357 (java) S 30349 30351 29719 0 -1 4202560 135841 0 0 0 347 25 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30358] ppid=30349 vsize=15752632 CPUtime=3.6 cores=1,3,5,7
/proc/30351/task/30358/stat : 30358 (java) S 30349 30351 29719 0 -1 4202560 126941 0 0 0 336 24 0 0 16 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30359] ppid=30349 vsize=15752632 CPUtime=3.5 cores=1,3,5,7
/proc/30351/task/30359/stat : 30359 (java) S 30349 30351 29719 0 -1 4202560 131581 0 0 0 326 24 0 0 16 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30360] ppid=30349 vsize=15752632 CPUtime=3.59 cores=1,3,5,7
/proc/30351/task/30360/stat : 30360 (java) S 30349 30351 29719 0 -1 4202560 130186 0 0 0 334 25 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30361] ppid=30349 vsize=15752632 CPUtime=3.65 cores=1,3,5,7
/proc/30351/task/30361/stat : 30361 (java) S 30349 30351 29719 0 -1 4202560 127946 0 0 0 341 24 0 0 15 0 22 0 608731795 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30362] ppid=30349 vsize=15752632 CPUtime=2.29 cores=1,3,5,7
/proc/30351/task/30362/stat : 30362 (java) S 30349 30351 29719 0 -1 4202560 5772 0 0 0 152 77 0 0 15 0 22 0 608731796 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 0 0 16800975 18446604454224045056 0 0 -1 5 0 0 0
[pid=30351/tid=30363] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30363/stat : 30363 (java) S 30349 30351 29719 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30364] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30364/stat : 30364 (java) S 30349 30351 29719 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 608731796 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30365] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30365/stat : 30365 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032219569 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30366] ppid=30349 vsize=15752632 CPUtime=0.67 cores=1,3,5,7
/proc/30351/task/30366/stat : 30366 (java) S 30349 30351 29719 0 -1 4202560 4530 0 0 0 67 0 0 0 15 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30367] ppid=30349 vsize=15752632 CPUtime=1.11 cores=1,3,5,7
/proc/30351/task/30367/stat : 30367 (java) S 30349 30351 29719 0 -1 4202560 8361 0 0 0 110 1 0 0 15 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 7 0 0 0
[pid=30351/tid=30368] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30368/stat : 30368 (java) S 30349 30351 29719 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032211865 0 4 0 16800975 18446604454224045056 0 0 -1 1 0 0 0
[pid=30351/tid=30369] ppid=30349 vsize=15752632 CPUtime=0 cores=1,3,5,7
/proc/30351/task/30369/stat : 30369 (java) S 30349 30351 29719 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 608731798 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 260032212480 0 4 0 16800975 18446604454224045056 0 0 -1 3 0 0 0
[pid=30351/tid=30370] ppid=30349 vsize=15752632 CPUtime=1191.82 cores=1,3,5,7
/proc/30351/task/30370/stat : 30370 (java) R 30349 30351 29719 0 -1 4202560 290264 0 0 0 119135 47 0 0 25 0 22 0 608731834 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912505931461 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=30351/tid=30371] ppid=30349 vsize=15752632 CPUtime=1191.03 cores=1,3,5,7
/proc/30351/task/30371/stat : 30371 (java) R 30349 30351 29719 0 -1 4202560 293258 0 0 0 119062 41 0 0 25 0 22 0 608731834 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506067260 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=30351/tid=30372] ppid=30349 vsize=15752632 CPUtime=1191.61 cores=1,3,5,7
/proc/30351/task/30372/stat : 30372 (java) R 30349 30351 29719 0 -1 4202560 283507 0 0 0 119115 46 0 0 25 0 22 0 608731834 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506025164 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=30351/tid=30373] ppid=30349 vsize=15752632 CPUtime=1192.05 cores=1,3,5,7
/proc/30351/task/30373/stat : 30373 (java) R 30349 30351 29719 0 -1 4202560 291390 0 0 0 119162 43 0 0 25 0 22 0 608731834 16130695168 65465 33554432000 1073741824 1073778376 140736159835424 18446744073709551615 46912506028345 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 15752632

Child status: 143
Real time (s): 1207.33
CPU time (s): 4800.27
CPU user time (s): 4795.61
CPU system time (s): 4.66029
CPU usage (%): 397.596
Max. virtual memory (cumulated for all children) (KiB): 15752636

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.61
system time used= 4.66029
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2239553
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 235912
involuntary context switches= 140100

runsolver used 2.11168 second user time and 4.51431 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-30 19:36:52
IDJOB=3311748
IDBENCH=83320
IDSOLVER=1698
FILE ID=node110/3311748-1304185012
RUNJOBID= node110-1304184717-30254
PBS_JOBID= 13172462
Free space on /tmp= 73472 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-17_279.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311748-1304185012/watcher-3311748-1304185012 -o /tmp/evaluation-result-3311748-1304185012/solver-3311748-1304185012 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311748-1304185012.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2562f4e152a54a992ab300a2bacfba9
RANDOM SEED=851091884

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30191744 kB
Buffers:       1005912 kB
Cached:         989796 kB
SwapCached:         64 kB
Active:         576012 kB
Inactive:      1770244 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30191744 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:            2056 kB
Writeback:           0 kB
AnonPages:      349872 kB
Mapped:          23608 kB
Slab:           348920 kB
PageTables:       5732 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   558676 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73472 MiB
End job on node110 at 2011-04-30 19:57:01