Trace number 3311469

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.4 1207.63

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S1216095115-028.SATISFIABLE.cnf
MD5SUMeeb610362e04643aaf1590ad5e0ca989
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.088986
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.09/0.18	00:42 INFO : Reading from input HOME/instance-3311469-1307656842.cnf
0.34/0.35	Executor set job limit to 1000000
0.34/0.35	Executor set job limit to 1000000
0.34/0.35	Executor set job limit to 1000000
0.34/0.35	Executor set job limit to 1000000
0.34/0.35	Starting Executor!
0.34/0.35	Starting Executor!
0.34/0.35	Starting Executor!
0.34/0.35	Starting Executor!
0.90/0.51	00:43 INFO : 150 variables remaining out of 150
0.90/0.51	00:43 INFO : 19170 literals remaining out of 19170

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3311469-1307656842/watcher-3311469-1307656842 -o /tmp/evaluation-result-3311469-1307656842/solver-3311469-1307656842 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3311469-1307656842.cnf -hbr 2 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.07 8.07 7.91 2/176 29033
/proc/meminfo: memFree=32100740/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=256 CPUtime=0 cores=1,3,5,7
/proc/29033/stat : 29033 (java) D 29029 29033 28625 0 -1 4194304 528 0 0 0 0 0 0 0 25 0 1 0 877283874 262144 33 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274469043701 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29033/statm: 64 33 24 9 0 23 0

[startup+0.0629281 s]
/proc/loadavg: 8.07 8.07 7.91 2/176 29033
/proc/meminfo: memFree=32100740/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15675184 CPUtime=0.05 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 4202 0 1 0 4 1 0 0 25 0 18 0 877283874 16051388416 3641 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3918796 3641 1768 9 0 3909515 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 15675184

[startup+0.100921 s]
/proc/loadavg: 8.07 8.07 7.91 2/176 29033
/proc/meminfo: memFree=32100740/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15676636 CPUtime=0.09 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 5362 0 1 0 7 2 0 0 25 0 18 0 877283874 16052875264 4801 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3919159 4801 2115 9 0 3909878 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 15676636

[startup+0.301603 s]
/proc/loadavg: 8.07 8.07 7.91 2/176 29033
/proc/meminfo: memFree=32100740/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15677404 CPUtime=0.34 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 8034 0 1 0 32 2 0 0 25 0 18 0 877283874 16053661696 7377 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3919351 7379 2198 9 0 3910070 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 15677404

[startup+1.3936 s]
/proc/loadavg: 8.07 8.07 7.91 2/176 29033
/proc/meminfo: memFree=32100740/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15699236 CPUtime=4.16 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 54077 0 1 0 407 9 0 0 25 0 22 0 877283874 16076017664 46144 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3924809 46146 2265 9 0 3915528 0
Current children cumulated CPU time (s) 4.16
Current children cumulated vsize (KiB) 15699236

[startup+1.71913 s]
/proc/loadavg: 8.07 8.07 7.91 2/176 29033
/proc/meminfo: memFree=32100740/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15699236 CPUtime=5.46 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 56518 0 1 0 537 9 0 0 25 0 22 0 877283874 16076017664 48571 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3924809 48571 2275 9 0 3915528 0
Current children cumulated CPU time (s) 5.46
Current children cumulated vsize (KiB) 15699236

[startup+3.1074 s]
/proc/loadavg: 8.55 8.17 7.95 10/220 29077
/proc/meminfo: memFree=31606652/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15699236 CPUtime=10.98 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 90796 0 1 0 1084 14 0 0 25 0 22 0 877283874 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3924809 82826 2285 9 0 3915528 0
[pid=29033/tid=29037] ppid=29029 vsize=15699236 CPUtime=0.43 cores=1,3,5,7
/proc/29033/task/29037/stat : 29037 (java) S 29029 29033 28625 0 -1 4202560 8096 0 1 0 41 2 0 0 20 0 22 0 877283875 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 3
[pid=29033/tid=29039] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29039/stat : 29039 (java) S 29029 29033 28625 0 -1 4202560 77 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29041] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29041/stat : 29041 (java) S 29029 29033 28625 0 -1 4202560 877 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29043] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29043/stat : 29043 (java) S 29029 29033 28625 0 -1 4202560 686 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29045] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29045/stat : 29045 (java) S 29029 29033 28625 0 -1 4202560 1351 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29047] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29047/stat : 29047 (java) S 29029 29033 28625 0 -1 4202560 575 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29049] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29049/stat : 29049 (java) S 29029 29033 28625 0 -1 4202560 827 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29051] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29051/stat : 29051 (java) S 29029 29033 28625 0 -1 4202560 2586 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29053] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29053/stat : 29053 (java) S 29029 29033 28625 0 -1 4202560 693 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29055] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29055/stat : 29055 (java) S 29029 29033 28625 0 -1 4202560 188 0 0 0 0 0 0 0 15 0 22 0 877283877 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 0 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29057] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29057/stat : 29057 (java) S 29029 29033 28625 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29059] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29059/stat : 29059 (java) S 29029 29033 28625 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29062] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29062/stat : 29062 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 877283879 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485791153 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29063] ppid=29029 vsize=15699236 CPUtime=1.3 cores=1,3,5,7
/proc/29033/task/29063/stat : 29063 (java) S 29029 29033 28625 0 -1 4202560 13757 0 0 0 129 1 0 0 15 0 22 0 877283879 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29066] ppid=29029 vsize=15699236 CPUtime=0.77 cores=1,3,5,7
/proc/29033/task/29066/stat : 29066 (java) S 29029 29033 28625 0 -1 4202560 4184 0 0 0 77 0 0 0 16 0 22 0 877283879 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29067] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29067/stat : 29067 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 877283879 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29069] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29069/stat : 29069 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 877283879 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29074] ppid=29029 vsize=15699236 CPUtime=2.36 cores=1,3,5,7
/proc/29033/task/29074/stat : 29074 (java) R 29029 29033 28625 0 -1 4202560 15823 0 0 0 234 2 0 0 19 0 22 0 877283909 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505666432 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=29033/tid=29075] ppid=29029 vsize=15699236 CPUtime=2.19 cores=1,3,5,7
/proc/29033/task/29075/stat : 29075 (java) R 29029 29033 28625 0 -1 4202560 14648 0 0 0 217 2 0 0 18 0 22 0 877283909 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46960627902043 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=29033/tid=29076] ppid=29029 vsize=15699236 CPUtime=1.73 cores=1,3,5,7
/proc/29033/task/29076/stat : 29076 (java) R 29029 29033 28625 0 -1 4202560 9292 0 0 0 173 0 0 0 20 0 22 0 877283909 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912506013846 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=29033/tid=29077] ppid=29029 vsize=15699236 CPUtime=2.06 cores=1,3,5,7
/proc/29033/task/29077/stat : 29077 (java) R 29029 29033 28625 0 -1 4202560 15750 0 0 0 205 1 0 0 20 0 22 0 877283909 16076017664 82826 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505707925 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10.98
Current children cumulated vsize (KiB) 15699236

[startup+6.30083 s]
/proc/loadavg: 8.55 8.17 7.95 10/220 29077
/proc/meminfo: memFree=31568124/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15699236 CPUtime=23.73 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 94119 0 1 0 2359 14 0 0 25 0 22 0 877283874 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3924809 83087 2285 9 0 3915528 0
[pid=29033/tid=29037] ppid=29029 vsize=15699236 CPUtime=0.43 cores=1,3,5,7
/proc/29033/task/29037/stat : 29037 (java) S 29029 29033 28625 0 -1 4202560 8096 0 1 0 41 2 0 0 20 0 22 0 877283875 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 3
[pid=29033/tid=29039] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29039/stat : 29039 (java) S 29029 29033 28625 0 -1 4202560 153 0 0 0 0 0 0 0 16 0 22 0 877283876 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29041] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7
/proc/29033/task/29041/stat : 29041 (java) S 29029 29033 28625 0 -1 4202560 1187 0 0 0 1 0 0 0 15 0 22 0 877283876 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29043] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29043/stat : 29043 (java) S 29029 29033 28625 0 -1 4202560 935 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29045] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29045/stat : 29045 (java) S 29029 29033 28625 0 -1 4202560 2164 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29047] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29047/stat : 29047 (java) S 29029 29033 28625 0 -1 4202560 849 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29049] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29049/stat : 29049 (java) S 29029 29033 28625 0 -1 4202560 1431 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29051] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29051/stat : 29051 (java) S 29029 29033 28625 0 -1 4202560 2990 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29053] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29053/stat : 29053 (java) S 29029 29033 28625 0 -1 4202560 937 0 0 0 0 0 0 0 15 0 22 0 877283876 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29055] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29055/stat : 29055 (java) S 29029 29033 28625 0 -1 4202560 188 0 0 0 0 0 0 0 15 0 22 0 877283877 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 0 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29057] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29057/stat : 29057 (java) S 29029 29033 28625 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29059] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29059/stat : 29059 (java) S 29029 29033 28625 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29062] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29062/stat : 29062 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 877283879 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485791153 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29063] ppid=29029 vsize=15699236 CPUtime=1.35 cores=1,3,5,7
/proc/29033/task/29063/stat : 29063 (java) S 29029 29033 28625 0 -1 4202560 13764 0 0 0 134 1 0 0 16 0 22 0 877283879 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29066] ppid=29029 vsize=15699236 CPUtime=0.84 cores=1,3,5,7
/proc/29033/task/29066/stat : 29066 (java) S 29029 29033 28625 0 -1 4202560 4195 0 0 0 84 0 0 0 15 0 22 0 877283879 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29067] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29067/stat : 29067 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 877283879 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29069] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29069/stat : 29069 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 877283879 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29074] ppid=29029 vsize=15699236 CPUtime=5.47 cores=1,3,5,7
/proc/29033/task/29074/stat : 29074 (java) R 29029 29033 28625 0 -1 4202560 15906 0 0 0 545 2 0 0 25 0 22 0 877283909 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912506022151 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=29033/tid=29075] ppid=29029 vsize=15699236 CPUtime=5.37 cores=1,3,5,7
/proc/29033/task/29075/stat : 29075 (java) R 29029 29033 28625 0 -1 4202560 14653 0 0 0 535 2 0 0 25 0 22 0 877283909 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=29033/tid=29076] ppid=29029 vsize=15699236 CPUtime=4.87 cores=1,3,5,7
/proc/29033/task/29076/stat : 29076 (java) R 29029 29033 28625 0 -1 4202560 9514 0 0 0 487 0 0 0 25 0 22 0 877283909 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505858510 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=29033/tid=29077] ppid=29029 vsize=15699236 CPUtime=5.26 cores=1,3,5,7
/proc/29033/task/29077/stat : 29077 (java) R 29029 29033 28625 0 -1 4202560 15771 0 0 0 524 2 0 0 25 0 22 0 877283909 16076017664 83087 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 18446744073699065904 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 23.73
Current children cumulated vsize (KiB) 15699236

[startup+12.7007 s]
/proc/loadavg: 8.54 8.18 7.95 10/220 29077
/proc/meminfo: memFree=31563472/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15699236 CPUtime=49.17 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 104338 0 1 0 4901 16 0 0 25 0 22 0 877283874 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3924809 84544 2290 9 0 3915528 0
[pid=29033/tid=29037] ppid=29029 vsize=15699236 CPUtime=0.43 cores=1,3,5,7
/proc/29033/task/29037/stat : 29037 (java) S 29029 29033 28625 0 -1 4202560 8096 0 1 0 41 2 0 0 20 0 22 0 877283875 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 3
[pid=29033/tid=29039] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7
/proc/29033/task/29039/stat : 29039 (java) S 29029 29033 28625 0 -1 4202560 1427 0 0 0 1 0 0 0 15 0 22 0 877283876 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29041] ppid=29029 vsize=15699236 CPUtime=0.02 cores=1,3,5,7
/proc/29033/task/29041/stat : 29041 (java) S 29029 29033 28625 0 -1 4202560 2565 0 0 0 2 0 0 0 15 0 22 0 877283876 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29043] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7
/proc/29033/task/29043/stat : 29043 (java) S 29029 29033 28625 0 -1 4202560 3046 0 0 0 1 0 0 0 15 0 22 0 877283876 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29045] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7
/proc/29033/task/29045/stat : 29045 (java) S 29029 29033 28625 0 -1 4202560 3389 0 0 0 1 0 0 0 15 0 22 0 877283876 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29047] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7
/proc/29033/task/29047/stat : 29047 (java) S 29029 29033 28625 0 -1 4202560 2026 0 0 0 1 0 0 0 15 0 22 0 877283876 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29049] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7
/proc/29033/task/29049/stat : 29049 (java) S 29029 29033 28625 0 -1 4202560 2625 0 0 0 1 0 0 0 15 0 22 0 877283876 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29051] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7
/proc/29033/task/29051/stat : 29051 (java) S 29029 29033 28625 0 -1 4202560 3974 0 0 0 1 0 0 0 15 0 22 0 877283876 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29053] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7
/proc/29033/task/29053/stat : 29053 (java) S 29029 29033 28625 0 -1 4202560 1742 0 0 0 1 0 0 0 15 0 22 0 877283876 16076017664 84544 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29055] ppid=29029 vsize=15699236 CPUtime=0.01 cores=1,3,5,7

################
# More data... #
################

[pid=29033/tid=29075] ppid=29029 vsize=15699236 CPUtime=1107.19 cores=1,3,5,7
/proc/29033/task/29075/stat : 29075 (java) R 29029 29033 28625 0 -1 4202560 173530 0 0 0 110685 34 0 0 25 0 22 0 877283909 16076017664 76707 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912506025943 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=29033/tid=29076] ppid=29029 vsize=15699236 CPUtime=1108.15 cores=1,3,5,7
/proc/29033/task/29076/stat : 29076 (java) R 29029 29033 28625 0 -1 4202560 172069 0 0 0 110785 30 0 0 25 0 22 0 877283909 16076017664 76707 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505654311 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=29033/tid=29077] ppid=29029 vsize=15699236 CPUtime=1108.3 cores=1,3,5,7
/proc/29033/task/29077/stat : 29077 (java) R 29029 29033 28625 0 -1 4202560 177298 0 0 0 110796 34 0 0 25 0 22 0 877283909 16076017664 76707 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505666444 0 4 0 16800975 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4461.1
Current children cumulated vsize (KiB) 15699236

[startup+1182.31 s]
/proc/loadavg: 7.99 8.02 8.00 10/220 29120
/proc/meminfo: memFree=31409280/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15699236 CPUtime=4699.72 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 1344989 0 1 0 469619 353 0 0 25 0 22 0 877283874 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3924809 83967 2298 9 0 3915528 0
[pid=29033/tid=29037] ppid=29029 vsize=15699236 CPUtime=0.43 cores=1,3,5,7
/proc/29033/task/29037/stat : 29037 (java) S 29029 29033 28625 0 -1 4202560 8096 0 1 0 41 2 0 0 20 0 22 0 877283875 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 3
[pid=29033/tid=29039] ppid=29029 vsize=15699236 CPUtime=3.18 cores=1,3,5,7
/proc/29033/task/29039/stat : 29039 (java) S 29029 29033 28625 0 -1 4202560 70446 0 0 0 300 18 0 0 16 0 22 0 877283876 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29041] ppid=29029 vsize=15699236 CPUtime=3.17 cores=1,3,5,7
/proc/29033/task/29041/stat : 29041 (java) S 29029 29033 28625 0 -1 4202560 72666 0 0 0 300 17 0 0 15 0 22 0 877283876 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29043] ppid=29029 vsize=15699236 CPUtime=3.1 cores=1,3,5,7
/proc/29033/task/29043/stat : 29043 (java) S 29029 29033 28625 0 -1 4202560 69267 0 0 0 294 16 0 0 15 0 22 0 877283876 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29045] ppid=29029 vsize=15699236 CPUtime=3.16 cores=1,3,5,7
/proc/29033/task/29045/stat : 29045 (java) S 29029 29033 28625 0 -1 4202560 72425 0 0 0 301 15 0 0 16 0 22 0 877283876 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29047] ppid=29029 vsize=15699236 CPUtime=3.23 cores=1,3,5,7
/proc/29033/task/29047/stat : 29047 (java) S 29029 29033 28625 0 -1 4202560 72225 0 0 0 306 17 0 0 15 0 22 0 877283876 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29049] ppid=29029 vsize=15699236 CPUtime=3.25 cores=1,3,5,7
/proc/29033/task/29049/stat : 29049 (java) S 29029 29033 28625 0 -1 4202560 74101 0 0 0 304 21 0 0 16 0 22 0 877283876 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29051] ppid=29029 vsize=15699236 CPUtime=3.19 cores=1,3,5,7
/proc/29033/task/29051/stat : 29051 (java) S 29029 29033 28625 0 -1 4202560 73161 0 0 0 301 18 0 0 15 0 22 0 877283876 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29053] ppid=29029 vsize=15699236 CPUtime=3.14 cores=1,3,5,7
/proc/29033/task/29053/stat : 29053 (java) S 29029 29033 28625 0 -1 4202560 67689 0 0 0 296 18 0 0 15 0 22 0 877283876 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29055] ppid=29029 vsize=15699236 CPUtime=2.31 cores=1,3,5,7
/proc/29033/task/29055/stat : 29055 (java) S 29029 29033 28625 0 -1 4202560 3277 0 0 0 170 61 0 0 16 0 22 0 877283877 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 0 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29057] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29057/stat : 29057 (java) S 29029 29033 28625 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29059] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29059/stat : 29059 (java) S 29029 29033 28625 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29062] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29062/stat : 29062 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 877283879 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485791153 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29063] ppid=29029 vsize=15699236 CPUtime=1.38 cores=1,3,5,7
/proc/29033/task/29063/stat : 29063 (java) S 29029 29033 28625 0 -1 4202560 13777 0 0 0 137 1 0 0 15 0 22 0 877283879 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29066] ppid=29029 vsize=15699236 CPUtime=0.91 cores=1,3,5,7
/proc/29033/task/29066/stat : 29066 (java) S 29029 29033 28625 0 -1 4202560 4208 0 0 0 91 0 0 0 15 0 22 0 877283879 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29067] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29067/stat : 29067 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 877283879 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29069] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29069/stat : 29069 (java) S 29029 29033 28625 0 -1 4202560 64 0 0 0 0 0 0 0 15 0 22 0 877283879 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29074] ppid=29029 vsize=15699236 CPUtime=1167.49 cores=1,3,5,7
/proc/29033/task/29074/stat : 29074 (java) R 29029 29033 28625 0 -1 4202560 185657 0 0 0 116713 36 0 0 25 0 22 0 877283909 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505776981 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=29033/tid=29075] ppid=29029 vsize=15699236 CPUtime=1166.49 cores=1,3,5,7
/proc/29033/task/29075/stat : 29075 (java) R 29029 29033 28625 0 -1 4202560 184349 0 0 0 116613 36 0 0 25 0 22 0 877283909 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505524151 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=29033/tid=29076] ppid=29029 vsize=15699236 CPUtime=1167.54 cores=1,3,5,7
/proc/29033/task/29076/stat : 29076 (java) R 29029 29033 28625 0 -1 4202560 183219 0 0 0 116722 32 0 0 25 0 22 0 877283909 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505808426 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=29033/tid=29077] ppid=29029 vsize=15699236 CPUtime=1167.6 cores=1,3,5,7
/proc/29033/task/29077/stat : 29077 (java) R 29029 29033 28625 0 -1 4202560 188977 0 0 0 116724 36 0 0 25 0 22 0 877283909 16076017664 83967 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505776936 0 4 0 16800975 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4699.72
Current children cumulated vsize (KiB) 15699236



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.61 s]
/proc/loadavg: 8.07 8.04 8.00 10/220 29121
/proc/meminfo: memFree=31539588/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15699236 CPUtime=4800.35 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 1364434 0 1 0 479674 361 0 0 25 0 22 0 877283874 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3924809 76886 2298 9 0 3915528 0
[pid=29033/tid=29037] ppid=29029 vsize=15699236 CPUtime=0.43 cores=1,3,5,7
/proc/29033/task/29037/stat : 29037 (java) S 29029 29033 28625 0 -1 4202560 8096 0 1 0 41 2 0 0 20 0 22 0 877283875 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 3
[pid=29033/tid=29039] ppid=29029 vsize=15699236 CPUtime=3.25 cores=1,3,5,7
/proc/29033/task/29039/stat : 29039 (java) S 29029 29033 28625 0 -1 4202560 71480 0 0 0 306 19 0 0 16 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29041] ppid=29029 vsize=15699236 CPUtime=3.24 cores=1,3,5,7
/proc/29033/task/29041/stat : 29041 (java) S 29029 29033 28625 0 -1 4202560 74537 0 0 0 306 18 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29043] ppid=29029 vsize=15699236 CPUtime=3.16 cores=1,3,5,7
/proc/29033/task/29043/stat : 29043 (java) S 29029 29033 28625 0 -1 4202560 70899 0 0 0 300 16 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29045] ppid=29029 vsize=15699236 CPUtime=3.23 cores=1,3,5,7
/proc/29033/task/29045/stat : 29045 (java) S 29029 29033 28625 0 -1 4202560 74279 0 0 0 308 15 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29047] ppid=29029 vsize=15699236 CPUtime=3.31 cores=1,3,5,7
/proc/29033/task/29047/stat : 29047 (java) S 29029 29033 28625 0 -1 4202560 73759 0 0 0 313 18 0 0 16 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29049] ppid=29029 vsize=15699236 CPUtime=3.34 cores=1,3,5,7
/proc/29033/task/29049/stat : 29049 (java) S 29029 29033 28625 0 -1 4202560 75718 0 0 0 312 22 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29051] ppid=29029 vsize=15699236 CPUtime=3.25 cores=1,3,5,7
/proc/29033/task/29051/stat : 29051 (java) S 29029 29033 28625 0 -1 4202560 75402 0 0 0 307 18 0 0 16 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29053] ppid=29029 vsize=15699236 CPUtime=3.23 cores=1,3,5,7
/proc/29033/task/29053/stat : 29053 (java) S 29029 29033 28625 0 -1 4202560 69721 0 0 0 304 19 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29055] ppid=29029 vsize=15699236 CPUtime=2.36 cores=1,3,5,7
/proc/29033/task/29055/stat : 29055 (java) S 29029 29033 28625 0 -1 4202560 3319 0 0 0 173 63 0 0 15 0 22 0 877283877 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 0 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29057] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29057/stat : 29057 (java) S 29029 29033 28625 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29059] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29059/stat : 29059 (java) S 29029 29033 28625 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29062] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29062/stat : 29062 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485791153 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29063] ppid=29029 vsize=15699236 CPUtime=1.38 cores=1,3,5,7
/proc/29033/task/29063/stat : 29063 (java) S 29029 29033 28625 0 -1 4202560 13777 0 0 0 137 1 0 0 15 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29066] ppid=29029 vsize=15699236 CPUtime=0.91 cores=1,3,5,7
/proc/29033/task/29066/stat : 29066 (java) S 29029 29033 28625 0 -1 4202560 4208 0 0 0 91 0 0 0 15 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29067] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29067/stat : 29067 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29069] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29069/stat : 29069 (java) S 29029 29033 28625 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29074] ppid=29029 vsize=15699236 CPUtime=1192.39 cores=1,3,5,7
/proc/29033/task/29074/stat : 29074 (java) R 29029 29033 28625 0 -1 4202560 187020 0 0 0 119203 36 0 0 25 0 22 0 877283909 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505798331 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=29033/tid=29075] ppid=29029 vsize=15699236 CPUtime=1191.53 cores=1,3,5,7
/proc/29033/task/29075/stat : 29075 (java) R 29029 29033 28625 0 -1 4202560 185680 0 0 0 119116 37 0 0 25 0 22 0 877283909 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912506013174 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=29033/tid=29076] ppid=29029 vsize=15699236 CPUtime=1192.58 cores=1,3,5,7
/proc/29033/task/29076/stat : 29076 (java) R 29029 29033 28625 0 -1 4202560 184566 0 0 0 119225 33 0 0 25 0 22 0 877283909 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505776936 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=29033/tid=29077] ppid=29029 vsize=15699236 CPUtime=1192.63 cores=1,3,5,7
/proc/29033/task/29077/stat : 29077 (java) R 29029 29033 28625 0 -1 4202560 190523 0 0 0 119227 36 0 0 25 0 22 0 877283909 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 15699236

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.61 s]
/proc/loadavg: 8.07 8.04 8.00 10/220 29121
/proc/meminfo: memFree=31539588/32950928 swapFree=67079488/67111528
[pid=29033] ppid=29029 vsize=15699236 CPUtime=4800.35 cores=1,3,5,7
/proc/29033/stat : 29033 (java) S 29029 29033 28625 0 -1 4202496 1364434 0 1 0 479674 361 0 0 25 0 22 0 877283874 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/29033/statm: 3924809 76886 2298 9 0 3915528 0
[pid=29033/tid=29037] ppid=29029 vsize=15699236 CPUtime=0.43 cores=1,3,5,7
/proc/29033/task/29037/stat : 29037 (java) S 29029 29033 28625 0 -1 4202560 8096 0 1 0 41 2 0 0 20 0 22 0 877283875 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 3
[pid=29033/tid=29039] ppid=29029 vsize=15699236 CPUtime=3.25 cores=1,3,5,7
/proc/29033/task/29039/stat : 29039 (java) S 29029 29033 28625 0 -1 4202560 71480 0 0 0 306 19 0 0 16 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29041] ppid=29029 vsize=15699236 CPUtime=3.24 cores=1,3,5,7
/proc/29033/task/29041/stat : 29041 (java) S 29029 29033 28625 0 -1 4202560 74537 0 0 0 306 18 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29043] ppid=29029 vsize=15699236 CPUtime=3.16 cores=1,3,5,7
/proc/29033/task/29043/stat : 29043 (java) S 29029 29033 28625 0 -1 4202560 70899 0 0 0 300 16 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29045] ppid=29029 vsize=15699236 CPUtime=3.23 cores=1,3,5,7
/proc/29033/task/29045/stat : 29045 (java) S 29029 29033 28625 0 -1 4202560 74279 0 0 0 308 15 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29047] ppid=29029 vsize=15699236 CPUtime=3.31 cores=1,3,5,7
/proc/29033/task/29047/stat : 29047 (java) S 29029 29033 28625 0 -1 4202560 73759 0 0 0 313 18 0 0 16 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 5 0 0 0
[pid=29033/tid=29049] ppid=29029 vsize=15699236 CPUtime=3.34 cores=1,3,5,7
/proc/29033/task/29049/stat : 29049 (java) S 29029 29033 28625 0 -1 4202560 75718 0 0 0 312 22 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29051] ppid=29029 vsize=15699236 CPUtime=3.25 cores=1,3,5,7
/proc/29033/task/29051/stat : 29051 (java) S 29029 29033 28625 0 -1 4202560 75402 0 0 0 307 18 0 0 16 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29053] ppid=29029 vsize=15699236 CPUtime=3.23 cores=1,3,5,7
/proc/29033/task/29053/stat : 29053 (java) S 29029 29033 28625 0 -1 4202560 69721 0 0 0 304 19 0 0 15 0 22 0 877283876 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29055] ppid=29029 vsize=15699236 CPUtime=2.36 cores=1,3,5,7
/proc/29033/task/29055/stat : 29055 (java) S 29029 29033 28625 0 -1 4202560 3319 0 0 0 173 63 0 0 15 0 22 0 877283877 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 0 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29057] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29057/stat : 29057 (java) S 29029 29033 28625 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29059] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29059/stat : 29059 (java) S 29029 29033 28625 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 877283877 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29062] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29062/stat : 29062 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485791153 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29063] ppid=29029 vsize=15699236 CPUtime=1.38 cores=1,3,5,7
/proc/29033/task/29063/stat : 29063 (java) S 29029 29033 28625 0 -1 4202560 13777 0 0 0 137 1 0 0 15 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29066] ppid=29029 vsize=15699236 CPUtime=0.91 cores=1,3,5,7
/proc/29033/task/29066/stat : 29066 (java) S 29029 29033 28625 0 -1 4202560 4208 0 0 0 91 0 0 0 15 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 7 0 0 0
[pid=29033/tid=29067] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29067/stat : 29067 (java) S 29029 29033 28625 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485783449 0 4 0 16800975 18446604471104321600 0 0 -1 3 0 0 0
[pid=29033/tid=29069] ppid=29029 vsize=15699236 CPUtime=0 cores=1,3,5,7
/proc/29033/task/29069/stat : 29069 (java) S 29029 29033 28625 0 -1 4202560 65 0 0 0 0 0 0 0 15 0 22 0 877283879 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 274485784064 0 4 0 16800975 18446604471104321600 0 0 -1 1 0 0 0
[pid=29033/tid=29074] ppid=29029 vsize=15699236 CPUtime=1192.39 cores=1,3,5,7
/proc/29033/task/29074/stat : 29074 (java) R 29029 29033 28625 0 -1 4202560 187020 0 0 0 119203 36 0 0 25 0 22 0 877283909 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505798331 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=29033/tid=29075] ppid=29029 vsize=15699236 CPUtime=1191.53 cores=1,3,5,7
/proc/29033/task/29075/stat : 29075 (java) R 29029 29033 28625 0 -1 4202560 185680 0 0 0 119116 37 0 0 25 0 22 0 877283909 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912506013174 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=29033/tid=29076] ppid=29029 vsize=15699236 CPUtime=1192.58 cores=1,3,5,7
/proc/29033/task/29076/stat : 29076 (java) R 29029 29033 28625 0 -1 4202560 184566 0 0 0 119225 33 0 0 25 0 22 0 877283909 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 46912505776936 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=29033/tid=29077] ppid=29029 vsize=15699236 CPUtime=1192.63 cores=1,3,5,7
/proc/29033/task/29077/stat : 29077 (java) R 29029 29033 28625 0 -1 4202560 190523 0 0 0 119227 36 0 0 25 0 22 0 877283909 16076017664 76886 33554432000 1073741824 1073778376 140735517511328 18446744073709551615 18446744073699065939 0 4 0 16800975 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 15699236

Child status: 143
Real time (s): 1207.63
CPU time (s): 4800.4
CPU user time (s): 4796.77
CPU system time (s): 3.62945
CPU usage (%): 397.504
Max. virtual memory (cumulated for all children) (KiB): 15699236

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.77
system time used= 3.62945
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1364461
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 319602
involuntary context switches= 179042

runsolver used 2.07368 second user time and 4.55231 second system time

The end

Launcher Data 

Begin job on node125 at 2011-06-10 00:00:42
IDJOB=3311469
IDBENCH=82854
IDSOLVER=1698
FILE ID=node125/3311469-1307656842
RUNJOBID= node125-1307656842-29007
PBS_JOBID= 13549420
Free space on /tmp= 74064 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S1216095115-028.SATISFIABLE.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3311469-1307656842/watcher-3311469-1307656842 -o /tmp/evaluation-result-3311469-1307656842/solver-3311469-1307656842 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3311469-1307656842.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= eeb610362e04643aaf1590ad5e0ca989
RANDOM SEED=731268959

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      32102076 kB
Buffers:        215176 kB
Cached:         401936 kB
SwapCached:       3400 kB
Active:         332780 kB
Inactive:       320892 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      32102076 kB
SwapTotal:    67111528 kB
SwapFree:     67079488 kB
Dirty:            3144 kB
Writeback:           0 kB
AnonPages:       34716 kB
Mapped:          13352 kB
Slab:           130356 kB
PageTables:       5052 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   192128 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74060 MiB
End job on node125 at 2011-06-10 00:20:52