Trace number 3311945

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.39 1207.14

General information on the benchmark

Namecrafted/skvortsov/
automata-synchronization/rnd_100_28_u.cnf
MD5SUM7fb794f1c5d1c4d1723aeeb5efb40cdc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark56.3054
Satisfiable
(Un)Satisfiability was proved
Number of variables2856
Number of clauses10578
Sum of the clauses size26556
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 25178
Number of clauses of size 35400
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.12	19:23 INFO : Reading from input HOME/instance-3311945-1307657963.cnf
0.51/0.31	Executor set job limit to 1000000
0.51/0.31	Executor set job limit to 1000000
0.51/0.31	Executor set job limit to 1000000
0.51/0.31	Executor set job limit to 1000000
0.51/0.31	Starting Executor!
0.51/0.31	Starting Executor!
0.51/0.31	Starting Executor!
0.51/0.31	Starting Executor!
1.30/0.64	19:24 INFO : 2448 variables remaining out of 2856
1.30/0.64	19:24 INFO : 45636 literals remaining out of 37134

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311945-1307657963/watcher-3311945-1307657963 -o /tmp/evaluation-result-3311945-1307657963/solver-3311945-1307657963 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311945-1307657963.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 6.99 4.55 5/198 12198
/proc/meminfo: memFree=32082944/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=23028 CPUtime=0 cores=1,3,5,7
/proc/12198/stat : 12198 (java) R 12196 12198 11597 0 -1 4202496 775 0 0 0 0 0 0 0 25 0 1 0 609987562 23580672 260 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268655699733 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12198/statm: 5757 270 215 9 0 124 0

[startup+0.00965009 s]
/proc/loadavg: 8.08 6.99 4.55 5/198 12198
/proc/meminfo: memFree=32082944/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=30536 CPUtime=0 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 1499 0 0 0 0 0 0 0 25 0 2 0 609987562 31268864 959 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16784584 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 7634 959 740 9 0 385 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 30536

[startup+0.10064 s]
/proc/loadavg: 8.08 6.99 4.55 5/198 12198
/proc/meminfo: memFree=32082944/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15676428 CPUtime=0.1 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 5558 0 1 0 9 1 0 0 25 0 18 0 609987562 16052662272 4970 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3919107 4970 2117 9 0 3909826 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676428

[startup+0.300613 s]
/proc/loadavg: 8.08 6.99 4.55 5/198 12198
/proc/meminfo: memFree=32082944/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15681468 CPUtime=0.51 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 15477 0 1 0 49 2 0 0 25 0 18 0 609987562 16057823232 13672 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3920367 13679 2207 9 0 3911086 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15681468

[startup+0.700527 s]
/proc/loadavg: 8.08 6.99 4.55 5/198 12198
/proc/meminfo: memFree=32082944/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15700676 CPUtime=1.58 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 28998 0 1 0 153 5 0 0 25 0 22 0 609987562 16077492224 24898 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3925169 24898 2258 9 0 3915888 0
Current children cumulated CPU time (s) 1.58
Current children cumulated vsize (KiB) 15700676

[startup+1.50135 s]
/proc/loadavg: 8.08 6.99 4.55 11/220 12220
/proc/meminfo: memFree=31957368/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15709260 CPUtime=4.58 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 60425 0 1 0 450 8 0 0 25 0 22 0 609987562 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3927315 51971 2272 9 0 3918034 0
[pid=12198/tid=12200] ppid=12196 vsize=15709260 CPUtime=0.63 cores=1,3,5,7
/proc/12198/task/12200/stat : 12200 (java) S 12196 12198 11597 0 -1 4202560 12500 0 1 0 61 2 0 0 20 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12201] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12201/stat : 12201 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12202] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12202/stat : 12202 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12203] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12203/stat : 12203 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12204] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12204/stat : 12204 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12205] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12205/stat : 12205 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12206] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12206/stat : 12206 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12207] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12207/stat : 12207 (java) S 12196 12198 11597 0 -1 4202560 986 0 0 0 0 0 0 0 18 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12208] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12208/stat : 12208 (java) R 12196 12198 11597 0 -1 4202560 766 0 0 0 0 0 0 0 18 0 22 0 609987563 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=12198/tid=12209] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12209/stat : 12209 (java) S 12196 12198 11597 0 -1 4202560 12 0 0 0 0 0 0 0 15 0 22 0 609987564 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 0 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12210] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12210/stat : 12210 (java) R 12196 12198 11597 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 22 0 609987565 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=12198/tid=12211] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12211/stat : 12211 (java) S 12196 12198 11597 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 22 0 609987565 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12212] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12212/stat : 12212 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672485809 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12213] ppid=12196 vsize=15709260 CPUtime=0.78 cores=1,3,5,7
/proc/12198/task/12213/stat : 12213 (java) R 12196 12198 11597 0 -1 4202560 7506 0 0 0 77 1 0 0 25 0 22 0 609987567 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 47743720469948 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=12198/tid=12214] ppid=12196 vsize=15709260 CPUtime=0.77 cores=1,3,5,7
/proc/12198/task/12214/stat : 12214 (java) R 12196 12198 11597 0 -1 4202560 14344 0 0 0 75 2 0 0 18 0 22 0 609987567 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 47743718959193 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=12198/tid=12215] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12215/stat : 12215 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12216] ppid=12196 vsize=15709260 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12216/stat : 12216 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 609987567 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12217] ppid=12196 vsize=15709260 CPUtime=0.65 cores=1,3,5,7
/proc/12198/task/12217/stat : 12217 (java) R 12196 12198 11597 0 -1 4202560 6407 0 0 0 65 0 0 0 16 0 22 0 609987593 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505216607 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=12198/tid=12218] ppid=12196 vsize=15709260 CPUtime=0.63 cores=1,3,5,7
/proc/12198/task/12218/stat : 12218 (java) R 12196 12198 11597 0 -1 4202560 6193 0 0 0 63 0 0 0 16 0 22 0 609987593 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505183275 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=12198/tid=12219] ppid=12196 vsize=15709260 CPUtime=0.54 cores=1,3,5,7
/proc/12198/task/12219/stat : 12219 (java) R 12196 12198 11597 0 -1 4202560 5161 0 0 0 54 0 0 0 16 0 22 0 609987594 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505857830 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=12198/tid=12220] ppid=12196 vsize=15709260 CPUtime=0.5 cores=1,3,5,7
/proc/12198/task/12220/stat : 12220 (java) R 12196 12198 11597 0 -1 4202560 5160 0 0 0 50 0 0 0 16 0 22 0 609987594 16086282240 51971 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505121146 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.58
Current children cumulated vsize (KiB) 15709260

[startup+3.10107 s]
/proc/loadavg: 8.08 6.99 4.55 13/220 12220
/proc/meminfo: memFree=31874408/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15706512 CPUtime=10.96 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 105191 0 1 0 1082 14 0 0 25 0 22 0 609987562 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3926628 91875 2284 9 0 3917347 0
[pid=12198/tid=12200] ppid=12196 vsize=15706512 CPUtime=0.63 cores=1,3,5,7
/proc/12198/task/12200/stat : 12200 (java) S 12196 12198 11597 0 -1 4202560 12500 0 1 0 61 2 0 0 20 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12201] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12201/stat : 12201 (java) S 12196 12198 11597 0 -1 4202560 3233 0 0 0 0 0 0 0 15 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12202] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12202/stat : 12202 (java) S 12196 12198 11597 0 -1 4202560 905 0 0 0 0 0 0 0 15 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12203] ppid=12196 vsize=15706512 CPUtime=0.01 cores=1,3,5,7
/proc/12198/task/12203/stat : 12203 (java) S 12196 12198 11597 0 -1 4202560 5457 0 0 0 1 0 0 0 16 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12204] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12204/stat : 12204 (java) S 12196 12198 11597 0 -1 4202560 1697 0 0 0 0 0 0 0 15 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12205] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12205/stat : 12205 (java) S 12196 12198 11597 0 -1 4202560 1811 0 0 0 0 0 0 0 15 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12206] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12206/stat : 12206 (java) S 12196 12198 11597 0 -1 4202560 1580 0 0 0 0 0 0 0 16 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12207] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12207/stat : 12207 (java) S 12196 12198 11597 0 -1 4202560 3847 0 0 0 0 0 0 0 16 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12208] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12208/stat : 12208 (java) S 12196 12198 11597 0 -1 4202560 766 0 0 0 0 0 0 0 15 0 22 0 609987563 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12209] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12209/stat : 12209 (java) S 12196 12198 11597 0 -1 4202560 207 0 0 0 0 0 0 0 15 0 22 0 609987564 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 0 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12210] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12210/stat : 12210 (java) S 12196 12198 11597 0 -1 4202560 16 0 0 0 0 0 0 0 16 0 22 0 609987565 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12211] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12211/stat : 12211 (java) S 12196 12198 11597 0 -1 4202560 9 0 0 0 0 0 0 0 16 0 22 0 609987565 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12212] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12212/stat : 12212 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672485809 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12213] ppid=12196 vsize=15706512 CPUtime=1.43 cores=1,3,5,7
/proc/12198/task/12213/stat : 12213 (java) R 12196 12198 11597 0 -1 4202560 7885 0 0 0 142 1 0 0 25 0 22 0 609987567 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=12198/tid=12214] ppid=12196 vsize=15706512 CPUtime=1.22 cores=1,3,5,7
/proc/12198/task/12214/stat : 12214 (java) S 12196 12198 11597 0 -1 4202560 18046 0 0 0 120 2 0 0 18 0 22 0 609987567 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12215] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12215/stat : 12215 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12216] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12216/stat : 12216 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 609987567 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12217] ppid=12196 vsize=15706512 CPUtime=2.23 cores=1,3,5,7
/proc/12198/task/12217/stat : 12217 (java) R 12196 12198 11597 0 -1 4202560 13813 0 0 0 222 1 0 0 18 0 22 0 609987593 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505750982 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=12198/tid=12218] ppid=12196 vsize=15706512 CPUtime=2 cores=1,3,5,7
/proc/12198/task/12218/stat : 12218 (java) R 12196 12198 11597 0 -1 4202560 14108 0 0 0 199 1 0 0 18 0 22 0 609987593 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505948321 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=12198/tid=12219] ppid=12196 vsize=15706512 CPUtime=1.84 cores=1,3,5,7
/proc/12198/task/12219/stat : 12219 (java) R 12196 12198 11597 0 -1 4202560 9012 0 0 0 183 1 0 0 16 0 22 0 609987594 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505766101 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=12198/tid=12220] ppid=12196 vsize=15706512 CPUtime=1.48 cores=1,3,5,7
/proc/12198/task/12220/stat : 12220 (java) R 12196 12198 11597 0 -1 4202560 8938 0 0 0 148 0 0 0 17 0 22 0 609987594 16083468288 91875 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505837947 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.96
Current children cumulated vsize (KiB) 15706512

[startup+6.30151 s]
/proc/loadavg: 8.15 7.03 4.57 9/220 12220
/proc/meminfo: memFree=30967008/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15706512 CPUtime=23.71 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 297177 0 1 0 2335 36 0 0 25 0 22 0 609987562 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3926628 281880 2284 9 0 3917347 0
[pid=12198/tid=12200] ppid=12196 vsize=15706512 CPUtime=0.63 cores=1,3,5,7
/proc/12198/task/12200/stat : 12200 (java) S 12196 12198 11597 0 -1 4202560 12500 0 1 0 61 2 0 0 20 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12201] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12201/stat : 12201 (java) S 12196 12198 11597 0 -1 4202560 4054 0 0 0 0 0 0 0 15 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12202] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12202/stat : 12202 (java) S 12196 12198 11597 0 -1 4202560 2474 0 0 0 0 0 0 0 15 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12203] ppid=12196 vsize=15706512 CPUtime=0.01 cores=1,3,5,7
/proc/12198/task/12203/stat : 12203 (java) S 12196 12198 11597 0 -1 4202560 8321 0 0 0 1 0 0 0 15 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12204] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12204/stat : 12204 (java) S 12196 12198 11597 0 -1 4202560 4155 0 0 0 0 0 0 0 16 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12205] ppid=12196 vsize=15706512 CPUtime=0.01 cores=1,3,5,7
/proc/12198/task/12205/stat : 12205 (java) S 12196 12198 11597 0 -1 4202560 5372 0 0 0 1 0 0 0 16 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12206] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12206/stat : 12206 (java) S 12196 12198 11597 0 -1 4202560 3725 0 0 0 0 0 0 0 15 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12207] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12207/stat : 12207 (java) S 12196 12198 11597 0 -1 4202560 4318 0 0 0 0 0 0 0 16 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12208] ppid=12196 vsize=15706512 CPUtime=0.01 cores=1,3,5,7
/proc/12198/task/12208/stat : 12208 (java) S 12196 12198 11597 0 -1 4202560 4507 0 0 0 1 0 0 0 16 0 22 0 609987563 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12209] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12209/stat : 12209 (java) S 12196 12198 11597 0 -1 4202560 761 0 0 0 0 0 0 0 15 0 22 0 609987564 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 0 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12210] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12210/stat : 12210 (java) S 12196 12198 11597 0 -1 4202560 16 0 0 0 0 0 0 0 16 0 22 0 609987565 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12211] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12211/stat : 12211 (java) S 12196 12198 11597 0 -1 4202560 9 0 0 0 0 0 0 0 16 0 22 0 609987565 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12212] ppid=12196 vsize=15706512 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12212/stat : 12212 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672485809 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12213] ppid=12196 vsize=15706512 CPUtime=1.58 cores=1,3,5,7
/proc/12198/task/12213/stat : 12213 (java) S 12196 12198 11597 0 -1 4202560 7896 0 0 0 157 1 0 0 16 0 22 0 609987567 16083468288 281880 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=12198/tid=12218] ppid=12196 vsize=15772048 CPUtime=1106.37 cores=1,3,5,7
/proc/12198/task/12218/stat : 12218 (java) R 12196 12198 11597 0 -1 4202560 423225 0 0 0 110576 61 0 0 25 0 22 0 609987593 16150577152 126420 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505523205 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=12198/tid=12219] ppid=12196 vsize=15772048 CPUtime=1107.67 cores=1,3,5,7
/proc/12198/task/12219/stat : 12219 (java) R 12196 12198 11597 0 -1 4202560 430788 0 0 0 110705 62 0 0 25 0 22 0 609987594 16150577152 126420 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505523231 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=12198/tid=12220] ppid=12196 vsize=15772048 CPUtime=1107.42 cores=1,3,5,7
/proc/12198/task/12220/stat : 12220 (java) R 12196 12198 11597 0 -1 4202560 415894 0 0 0 110680 62 0 0 25 0 22 0 609987594 16150577152 126420 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 18446744073699066094 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4462.96
Current children cumulated vsize (KiB) 15772048

[startup+1182.3 s]
/proc/loadavg: 4.07 4.84 5.44 6/193 12279
/proc/meminfo: memFree=31924556/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15772048 CPUtime=4701.63 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 3109519 0 1 0 469569 594 0 0 25 0 22 0 609987562 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3943012 137588 2298 9 0 3933731 0
[pid=12198/tid=12200] ppid=12196 vsize=15772048 CPUtime=0.63 cores=1,3,5,7
/proc/12198/task/12200/stat : 12200 (java) S 12196 12198 11597 0 -1 4202560 12500 0 1 0 61 2 0 0 20 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12201] ppid=12196 vsize=15772048 CPUtime=3.63 cores=1,3,5,7
/proc/12198/task/12201/stat : 12201 (java) S 12196 12198 11597 0 -1 4202560 155020 0 0 0 332 31 0 0 15 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12202] ppid=12196 vsize=15772048 CPUtime=3.53 cores=1,3,5,7
/proc/12198/task/12202/stat : 12202 (java) S 12196 12198 11597 0 -1 4202560 155643 0 0 0 325 28 0 0 15 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12203] ppid=12196 vsize=15772048 CPUtime=3.56 cores=1,3,5,7
/proc/12198/task/12203/stat : 12203 (java) S 12196 12198 11597 0 -1 4202560 157532 0 0 0 326 30 0 0 15 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12204] ppid=12196 vsize=15772048 CPUtime=3.57 cores=1,3,5,7
/proc/12198/task/12204/stat : 12204 (java) S 12196 12198 11597 0 -1 4202560 158155 0 0 0 327 30 0 0 16 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12205] ppid=12196 vsize=15772048 CPUtime=3.59 cores=1,3,5,7
/proc/12198/task/12205/stat : 12205 (java) S 12196 12198 11597 0 -1 4202560 155252 0 0 0 327 32 0 0 15 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12206] ppid=12196 vsize=15772048 CPUtime=3.57 cores=1,3,5,7
/proc/12198/task/12206/stat : 12206 (java) S 12196 12198 11597 0 -1 4202560 163120 0 0 0 327 30 0 0 16 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12207] ppid=12196 vsize=15772048 CPUtime=3.51 cores=1,3,5,7
/proc/12198/task/12207/stat : 12207 (java) S 12196 12198 11597 0 -1 4202560 152649 0 0 0 320 31 0 0 16 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12208] ppid=12196 vsize=15772048 CPUtime=3.54 cores=1,3,5,7
/proc/12198/task/12208/stat : 12208 (java) S 12196 12198 11597 0 -1 4202560 151060 0 0 0 326 28 0 0 15 0 22 0 609987563 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12209] ppid=12196 vsize=15772048 CPUtime=2.47 cores=1,3,5,7
/proc/12198/task/12209/stat : 12209 (java) S 12196 12198 11597 0 -1 4202560 8467 0 0 0 169 78 0 0 15 0 22 0 609987564 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 0 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12210] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12210/stat : 12210 (java) S 12196 12198 11597 0 -1 4202560 16 0 0 0 0 0 0 0 16 0 22 0 609987565 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12211] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12211/stat : 12211 (java) S 12196 12198 11597 0 -1 4202560 9 0 0 0 0 0 0 0 16 0 22 0 609987565 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12212] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12212/stat : 12212 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672485809 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12213] ppid=12196 vsize=15772048 CPUtime=1.64 cores=1,3,5,7
/proc/12198/task/12213/stat : 12213 (java) S 12196 12198 11597 0 -1 4202560 7896 0 0 0 163 1 0 0 15 0 22 0 609987567 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12214] ppid=12196 vsize=15772048 CPUtime=1.52 cores=1,3,5,7
/proc/12198/task/12214/stat : 12214 (java) S 12196 12198 11597 0 -1 4202560 18072 0 0 0 150 2 0 0 15 0 22 0 609987567 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12215] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12215/stat : 12215 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12216] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12216/stat : 12216 (java) S 12196 12198 11597 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 609987567 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12217] ppid=12196 vsize=15772048 CPUtime=1167.38 cores=1,3,5,7
/proc/12198/task/12217/stat : 12217 (java) R 12196 12198 11597 0 -1 4202560 460782 0 0 0 116674 64 0 0 25 0 22 0 609987593 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505857813 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=12198/tid=12218] ppid=12196 vsize=15772048 CPUtime=1165.66 cores=1,3,5,7
/proc/12198/task/12218/stat : 12218 (java) R 12196 12198 11597 0 -1 4202560 450887 0 0 0 116501 65 0 0 25 0 22 0 609987593 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 18446744073699065911 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=12198/tid=12219] ppid=12196 vsize=15772048 CPUtime=1166.89 cores=1,3,5,7
/proc/12198/task/12219/stat : 12219 (java) R 12196 12198 11597 0 -1 4202560 458115 0 0 0 116623 66 0 0 25 0 22 0 609987594 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 18446744073699065949 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=12198/tid=12220] ppid=12196 vsize=15772048 CPUtime=1166.74 cores=1,3,5,7
/proc/12198/task/12220/stat : 12220 (java) R 12196 12198 11597 0 -1 4202560 442919 0 0 0 116609 65 0 0 25 0 22 0 609987594 16150577152 137588 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505765800 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4701.63
Current children cumulated vsize (KiB) 15772048



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.1 s]
/proc/loadavg: 4.05 4.77 5.40 5/193 12279
/proc/meminfo: memFree=31915852/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15772048 CPUtime=4800.33 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 3164542 0 1 0 479428 605 0 0 25 0 22 0 609987562 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3943012 125752 2298 9 0 3933731 0
[pid=12198/tid=12200] ppid=12196 vsize=15772048 CPUtime=0.63 cores=1,3,5,7
/proc/12198/task/12200/stat : 12200 (java) S 12196 12198 11597 0 -1 4202560 12500 0 1 0 61 2 0 0 20 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12201] ppid=12196 vsize=15772048 CPUtime=3.7 cores=1,3,5,7
/proc/12198/task/12201/stat : 12201 (java) S 12196 12198 11597 0 -1 4202560 157990 0 0 0 339 31 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12202] ppid=12196 vsize=15772048 CPUtime=3.61 cores=1,3,5,7
/proc/12198/task/12202/stat : 12202 (java) S 12196 12198 11597 0 -1 4202560 158480 0 0 0 332 29 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12203] ppid=12196 vsize=15772048 CPUtime=3.64 cores=1,3,5,7
/proc/12198/task/12203/stat : 12203 (java) S 12196 12198 11597 0 -1 4202560 161427 0 0 0 333 31 0 0 16 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12204] ppid=12196 vsize=15772048 CPUtime=3.64 cores=1,3,5,7
/proc/12198/task/12204/stat : 12204 (java) S 12196 12198 11597 0 -1 4202560 162449 0 0 0 333 31 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12205] ppid=12196 vsize=15772048 CPUtime=3.67 cores=1,3,5,7
/proc/12198/task/12205/stat : 12205 (java) S 12196 12198 11597 0 -1 4202560 158090 0 0 0 334 33 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12206] ppid=12196 vsize=15772048 CPUtime=3.66 cores=1,3,5,7
/proc/12198/task/12206/stat : 12206 (java) S 12196 12198 11597 0 -1 4202560 165864 0 0 0 335 31 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12207] ppid=12196 vsize=15772048 CPUtime=3.59 cores=1,3,5,7
/proc/12198/task/12207/stat : 12207 (java) S 12196 12198 11597 0 -1 4202560 155211 0 0 0 327 32 0 0 16 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12208] ppid=12196 vsize=15772048 CPUtime=3.63 cores=1,3,5,7
/proc/12198/task/12208/stat : 12208 (java) S 12196 12198 11597 0 -1 4202560 153218 0 0 0 334 29 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12209] ppid=12196 vsize=15772048 CPUtime=2.51 cores=1,3,5,7
/proc/12198/task/12209/stat : 12209 (java) S 12196 12198 11597 0 -1 4202560 8551 0 0 0 172 79 0 0 15 0 22 0 609987564 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 0 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12210] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12210/stat : 12210 (java) S 12196 12198 11597 0 -1 4202560 16 0 0 0 0 0 0 0 16 0 22 0 609987565 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12211] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12211/stat : 12211 (java) S 12196 12198 11597 0 -1 4202560 9 0 0 0 0 0 0 0 16 0 22 0 609987565 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12212] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12212/stat : 12212 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672485809 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12213] ppid=12196 vsize=15772048 CPUtime=1.64 cores=1,3,5,7
/proc/12198/task/12213/stat : 12213 (java) S 12196 12198 11597 0 -1 4202560 7896 0 0 0 163 1 0 0 15 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12214] ppid=12196 vsize=15772048 CPUtime=1.52 cores=1,3,5,7
/proc/12198/task/12214/stat : 12214 (java) S 12196 12198 11597 0 -1 4202560 18072 0 0 0 150 2 0 0 15 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12215] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12215/stat : 12215 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12216] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12216/stat : 12216 (java) S 12196 12198 11597 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12217] ppid=12196 vsize=15772048 CPUtime=1191.93 cores=1,3,5,7
/proc/12198/task/12217/stat : 12217 (java) R 12196 12198 11597 0 -1 4202560 468615 0 0 0 119128 65 0 0 25 0 22 0 609987593 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912506060218 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=12198/tid=12218] ppid=12196 vsize=15772048 CPUtime=1190.14 cores=1,3,5,7
/proc/12198/task/12218/stat : 12218 (java) R 12196 12198 11597 0 -1 4202560 458252 0 0 0 118948 66 0 0 25 0 22 0 609987593 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505837880 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=12198/tid=12219] ppid=12196 vsize=15772048 CPUtime=1191.42 cores=1,3,5,7
/proc/12198/task/12219/stat : 12219 (java) R 12196 12198 11597 0 -1 4202560 464940 0 0 0 119075 67 0 0 25 0 22 0 609987594 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 47743723436171 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=12198/tid=12220] ppid=12196 vsize=15772048 CPUtime=1191.24 cores=1,3,5,7
/proc/12198/task/12220/stat : 12220 (java) R 12196 12198 11597 0 -1 4202560 451535 0 0 0 119058 66 0 0 25 0 22 0 609987594 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505766206 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 15772048

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.1 s]
/proc/loadavg: 4.05 4.77 5.40 5/193 12279
/proc/meminfo: memFree=31915852/32951124 swapFree=67055708/67111528
[pid=12198] ppid=12196 vsize=15772048 CPUtime=4800.33 cores=1,3,5,7
/proc/12198/stat : 12198 (java) S 12196 12198 11597 0 -1 4202496 3164542 0 1 0 479428 605 0 0 25 0 22 0 609987562 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672464869 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/12198/statm: 3943012 125752 2298 9 0 3933731 0
[pid=12198/tid=12200] ppid=12196 vsize=15772048 CPUtime=0.63 cores=1,3,5,7
/proc/12198/task/12200/stat : 12200 (java) S 12196 12198 11597 0 -1 4202560 12500 0 1 0 61 2 0 0 20 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12201] ppid=12196 vsize=15772048 CPUtime=3.7 cores=1,3,5,7
/proc/12198/task/12201/stat : 12201 (java) S 12196 12198 11597 0 -1 4202560 157990 0 0 0 339 31 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12202] ppid=12196 vsize=15772048 CPUtime=3.61 cores=1,3,5,7
/proc/12198/task/12202/stat : 12202 (java) S 12196 12198 11597 0 -1 4202560 158480 0 0 0 332 29 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12203] ppid=12196 vsize=15772048 CPUtime=3.64 cores=1,3,5,7
/proc/12198/task/12203/stat : 12203 (java) S 12196 12198 11597 0 -1 4202560 161427 0 0 0 333 31 0 0 16 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12204] ppid=12196 vsize=15772048 CPUtime=3.64 cores=1,3,5,7
/proc/12198/task/12204/stat : 12204 (java) S 12196 12198 11597 0 -1 4202560 162449 0 0 0 333 31 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12205] ppid=12196 vsize=15772048 CPUtime=3.67 cores=1,3,5,7
/proc/12198/task/12205/stat : 12205 (java) S 12196 12198 11597 0 -1 4202560 158090 0 0 0 334 33 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12206] ppid=12196 vsize=15772048 CPUtime=3.66 cores=1,3,5,7
/proc/12198/task/12206/stat : 12206 (java) S 12196 12198 11597 0 -1 4202560 165864 0 0 0 335 31 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 7 0 0 0
[pid=12198/tid=12207] ppid=12196 vsize=15772048 CPUtime=3.59 cores=1,3,5,7
/proc/12198/task/12207/stat : 12207 (java) S 12196 12198 11597 0 -1 4202560 155211 0 0 0 327 32 0 0 16 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 3 0 0 0
[pid=12198/tid=12208] ppid=12196 vsize=15772048 CPUtime=3.63 cores=1,3,5,7
/proc/12198/task/12208/stat : 12208 (java) S 12196 12198 11597 0 -1 4202560 153218 0 0 0 334 29 0 0 15 0 22 0 609987563 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12209] ppid=12196 vsize=15772048 CPUtime=2.51 cores=1,3,5,7
/proc/12198/task/12209/stat : 12209 (java) S 12196 12198 11597 0 -1 4202560 8551 0 0 0 172 79 0 0 15 0 22 0 609987564 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 0 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12210] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12210/stat : 12210 (java) S 12196 12198 11597 0 -1 4202560 16 0 0 0 0 0 0 0 16 0 22 0 609987565 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12211] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12211/stat : 12211 (java) S 12196 12198 11597 0 -1 4202560 9 0 0 0 0 0 0 0 16 0 22 0 609987565 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12212] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12212/stat : 12212 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672485809 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12213] ppid=12196 vsize=15772048 CPUtime=1.64 cores=1,3,5,7
/proc/12198/task/12213/stat : 12213 (java) S 12196 12198 11597 0 -1 4202560 7896 0 0 0 163 1 0 0 15 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12214] ppid=12196 vsize=15772048 CPUtime=1.52 cores=1,3,5,7
/proc/12198/task/12214/stat : 12214 (java) S 12196 12198 11597 0 -1 4202560 18072 0 0 0 150 2 0 0 15 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 1 0 0 0
[pid=12198/tid=12215] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12215/stat : 12215 (java) S 12196 12198 11597 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478105 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12216] ppid=12196 vsize=15772048 CPUtime=0 cores=1,3,5,7
/proc/12198/task/12216/stat : 12216 (java) S 12196 12198 11597 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 609987567 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 268672478720 0 4 0 16800975 18446604471140309056 0 0 -1 5 0 0 0
[pid=12198/tid=12217] ppid=12196 vsize=15772048 CPUtime=1191.93 cores=1,3,5,7
/proc/12198/task/12217/stat : 12217 (java) R 12196 12198 11597 0 -1 4202560 468615 0 0 0 119128 65 0 0 25 0 22 0 609987593 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912506060218 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=12198/tid=12218] ppid=12196 vsize=15772048 CPUtime=1190.14 cores=1,3,5,7
/proc/12198/task/12218/stat : 12218 (java) R 12196 12198 11597 0 -1 4202560 458252 0 0 0 118948 66 0 0 25 0 22 0 609987593 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505837880 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=12198/tid=12219] ppid=12196 vsize=15772048 CPUtime=1191.42 cores=1,3,5,7
/proc/12198/task/12219/stat : 12219 (java) R 12196 12198 11597 0 -1 4202560 464940 0 0 0 119075 67 0 0 25 0 22 0 609987594 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 47743723436171 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=12198/tid=12220] ppid=12196 vsize=15772048 CPUtime=1191.24 cores=1,3,5,7
/proc/12198/task/12220/stat : 12220 (java) R 12196 12198 11597 0 -1 4202560 451535 0 0 0 119058 66 0 0 25 0 22 0 609987594 16150577152 125752 33554432000 1073741824 1073778376 140733254246544 18446744073709551615 46912505766206 0 4 0 16800975 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 15772048

Child status: 143
Real time (s): 1207.14
CPU time (s): 4800.39
CPU user time (s): 4794.32
CPU system time (s): 6.07108
CPU usage (%): 397.668
Max. virtual memory (cumulated for all children) (KiB): 15772048

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.32
system time used= 6.07108
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3164567
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 200945
involuntary context switches= 120717

runsolver used 1.9647 second user time and 4.67229 second system time

The end

Launcher Data 

Begin job on node107 at 2011-06-10 00:19:23
IDJOB=3311945
IDBENCH=83192
IDSOLVER=1698
FILE ID=node107/3311945-1307657963
RUNJOBID= node107-1307657460-12077
PBS_JOBID= 13549415
Free space on /tmp= 74100 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/rnd_100_28_u.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311945-1307657963/watcher-3311945-1307657963 -o /tmp/evaluation-result-3311945-1307657963/solver-3311945-1307657963 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311945-1307657963.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7fb794f1c5d1c4d1723aeeb5efb40cdc
RANDOM SEED=465919976

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32083744 kB
Buffers:         75216 kB
Cached:         248056 kB
SwapCached:      19468 kB
Active:         459600 kB
Inactive:       221288 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32083744 kB
SwapTotal:    67111528 kB
SwapFree:     67055708 kB
Dirty:            1696 kB
Writeback:           0 kB
AnonPages:      355332 kB
Mapped:          21396 kB
Slab:           120796 kB
PageTables:       5888 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   587604 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74100 MiB
End job on node107 at 2011-06-10 00:39:32