Trace number 3312247

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1 (hbr=2)? (TO) 4800.47 1205.06

General information on the benchmark

NameSAT03/industrial/li/li-exam/
li-exam-61.shuffled-as.sat03-366.cnf
MD5SUM3be662940f394fa876137a905247d755
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables28147
Number of clauses108436
Sum of the clauses size373110
Maximum clause length166
Minimum clause length1
Number of clauses of size 114
Number of clauses of size 218786
Number of clauses of size 351588
Number of clauses of size 437440
Number of clauses of size 53
Number of clauses of size over 5605

Solver Data 

0.10/0.12	03:06 INFO : Reading from input HOME/instance-3312247-1304186586.cnf
0.92/0.75	Executor set job limit to 1000000
0.92/0.75	Executor set job limit to 1000000
0.92/0.75	Executor set job limit to 1000000
0.92/0.75	Executor set job limit to 1000000
0.92/0.75	Starting Executor!
0.92/0.75	Starting Executor!
0.92/0.75	Starting Executor!
0.92/0.75	Starting Executor!
3.36/1.98	03:08 INFO : Found 9380 xor gates
5.09/2.73	03:09 INFO : 23391 variables remaining out of 28147
5.09/2.73	03:09 INFO : 462691 literals remaining out of 261346

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312247-1304186586/watcher-3312247-1304186586 -o /tmp/evaluation-result-3312247-1304186586/solver-3312247-1304186586 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312247-1304186586.cnf -hbr 2 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.59 7.71 7.85 2/174 28994
/proc/meminfo: memFree=21971836/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=23028 CPUtime=0 cores=0,2,4,6
/proc/28994/stat : 28994 (java) R 28992 28994 28962 0 -1 4202496 1170 0 0 0 0 0 0 0 23 0 1 0 511074209 23580672 656 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264721442581 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28994/statm: 5757 668 495 9 0 124 0

[startup+0.0105519 s]
/proc/loadavg: 6.59 7.71 7.85 2/174 28994
/proc/meminfo: memFree=21971836/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=35820 CPUtime=0 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 1590 0 1 0 0 0 0 0 23 0 2 0 511074209 36679680 1035 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16784584 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 8955 1035 800 9 0 386 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 35820

[startup+0.100501 s]
/proc/loadavg: 6.59 7.71 7.85 2/174 28994
/proc/meminfo: memFree=21971836/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15676948 CPUtime=0.1 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 5553 0 1 0 9 1 0 0 23 0 18 0 511074209 16053194752 4992 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3919237 4993 2116 9 0 3909956 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676948

[startup+0.300444 s]
/proc/loadavg: 6.59 7.71 7.85 2/174 28994
/proc/meminfo: memFree=21971836/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15682624 CPUtime=0.51 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 14884 0 1 0 49 2 0 0 23 0 18 0 511074209 16059006976 13093 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3920656 13093 2206 9 0 3911375 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 15682624

[startup+0.700369 s]
/proc/loadavg: 6.59 7.71 7.85 2/174 28994
/proc/meminfo: memFree=21971836/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15682624 CPUtime=0.92 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 41803 0 1 0 86 6 0 0 23 0 18 0 511074209 16059006976 40008 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3920656 40008 2222 9 0 3911375 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 15682624

[startup+1.50128 s]
/proc/loadavg: 6.59 7.71 7.85 4/216 29039
/proc/meminfo: memFree=21642780/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15715888 CPUtime=2.48 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 57916 0 1 0 240 8 0 0 23 0 22 0 511074209 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3928972 52138 2257 9 0 3919691 0
[pid=28994/tid=28996] ppid=28992 vsize=15715888 CPUtime=1.45 cores=0,2,4,6
/proc/28994/task/28996/stat : 28996 (java) R 28992 28994 28962 0 -1 4202560 35622 0 1 0 140 5 0 0 18 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 47198099844592 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28994/tid=28997] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/28997/stat : 28997 (java) S 28992 28994 28962 0 -1 4202560 842 0 0 0 0 0 0 0 16 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=28998] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/28998/stat : 28998 (java) S 28992 28994 28962 0 -1 4202560 1228 0 0 0 0 0 0 0 16 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=28999] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/28999/stat : 28999 (java) S 28992 28994 28962 0 -1 4202560 1043 0 0 0 0 0 0 0 16 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29000] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29000/stat : 29000 (java) S 28992 28994 28962 0 -1 4202560 676 0 0 0 0 0 0 0 16 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29001] ppid=28992 vsize=15715888 CPUtime=0.01 cores=0,2,4,6
/proc/28994/task/29001/stat : 29001 (java) S 28992 28994 28962 0 -1 4202560 1345 0 0 0 1 0 0 0 16 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29002] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29002/stat : 29002 (java) S 28992 28994 28962 0 -1 4202560 9 0 0 0 0 0 0 0 16 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29003] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29003/stat : 29003 (java) S 28992 28994 28962 0 -1 4202560 367 0 0 0 0 0 0 0 16 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29004] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29004/stat : 29004 (java) S 28992 28994 28962 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 22 0 511074210 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29005] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29005/stat : 29005 (java) S 28992 28994 28962 0 -1 4202560 72 0 0 0 0 0 0 0 16 0 22 0 511074211 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 0 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29006] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29006/stat : 29006 (java) S 28992 28994 28962 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 511074212 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29007] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29007/stat : 29007 (java) S 28992 28994 28962 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 22 0 511074212 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29008] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29008/stat : 29008 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738228657 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29009] ppid=28992 vsize=15715888 CPUtime=0.2 cores=0,2,4,6
/proc/28994/task/29009/stat : 29009 (java) S 28992 28994 28962 0 -1 4202560 1336 0 0 0 20 0 0 0 15 0 22 0 511074214 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29010] ppid=28992 vsize=15715888 CPUtime=0.75 cores=0,2,4,6
/proc/28994/task/29010/stat : 29010 (java) R 28992 28994 28962 0 -1 4202560 13901 0 0 0 74 1 0 0 16 0 22 0 511074214 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 47198096811026 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28994/tid=29011] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29011/stat : 29011 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29012] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29012/stat : 29012 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 511074214 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29036] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29036/stat : 29036 (java) S 28992 28994 28962 0 -1 4202560 14 0 0 0 0 0 0 0 15 0 22 0 511074285 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29037] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29037/stat : 29037 (java) S 28992 28994 28962 0 -1 4202560 14 0 0 0 0 0 0 0 15 0 22 0 511074285 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29038] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29038/stat : 29038 (java) S 28992 28994 28962 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 511074285 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29039] ppid=28992 vsize=15715888 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29039/stat : 29039 (java) S 28992 28994 28962 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 511074285 16093069312 52138 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.48
Current children cumulated vsize (KiB) 15715888

[startup+3.10088 s]
/proc/loadavg: 6.30 7.63 7.82 6/220 29043
/proc/meminfo: memFree=21589468/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15714952 CPUtime=5.98 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 65767 0 1 0 588 10 0 0 23 0 22 0 511074209 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3928738 53185 2278 9 0 3919457 0
[pid=28994/tid=28996] ppid=28992 vsize=15714952 CPUtime=2.69 cores=0,2,4,6
/proc/28994/task/28996/stat : 28996 (java) S 28992 28994 28962 0 -1 4202560 35708 0 1 0 264 5 0 0 21 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=28997] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/28997/stat : 28997 (java) S 28992 28994 28962 0 -1 4202560 842 0 0 0 0 0 0 0 16 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=28998] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/28998/stat : 28998 (java) S 28992 28994 28962 0 -1 4202560 1228 0 0 0 0 0 0 0 16 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=28999] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/28999/stat : 28999 (java) S 28992 28994 28962 0 -1 4202560 1043 0 0 0 0 0 0 0 16 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29000] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29000/stat : 29000 (java) S 28992 28994 28962 0 -1 4202560 676 0 0 0 0 0 0 0 16 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29001] ppid=28992 vsize=15714952 CPUtime=0.01 cores=0,2,4,6
/proc/28994/task/29001/stat : 29001 (java) S 28992 28994 28962 0 -1 4202560 1345 0 0 0 1 0 0 0 16 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29002] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29002/stat : 29002 (java) S 28992 28994 28962 0 -1 4202560 9 0 0 0 0 0 0 0 16 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29003] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29003/stat : 29003 (java) S 28992 28994 28962 0 -1 4202560 367 0 0 0 0 0 0 0 16 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29004] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29004/stat : 29004 (java) S 28992 28994 28962 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 22 0 511074210 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29005] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29005/stat : 29005 (java) S 28992 28994 28962 0 -1 4202560 74 0 0 0 0 0 0 0 16 0 22 0 511074211 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 0 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29006] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29006/stat : 29006 (java) S 28992 28994 28962 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29007] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29007/stat : 29007 (java) S 28992 28994 28962 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29008] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29008/stat : 29008 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738228657 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29009] ppid=28992 vsize=15714952 CPUtime=0.76 cores=0,2,4,6
/proc/28994/task/29009/stat : 29009 (java) S 28992 28994 28962 0 -1 4202560 5581 0 0 0 75 1 0 0 15 0 22 0 511074214 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29010] ppid=28992 vsize=15714952 CPUtime=1.92 cores=0,2,4,6
/proc/28994/task/29010/stat : 29010 (java) R 28992 28994 28962 0 -1 4202560 17408 0 0 0 191 1 0 0 15 0 22 0 511074214 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 47198095303126 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28994/tid=29011] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29011/stat : 29011 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29012] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29012/stat : 29012 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 511074214 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29036] ppid=28992 vsize=15714952 CPUtime=0.31 cores=0,2,4,6
/proc/28994/task/29036/stat : 29036 (java) R 28992 28994 28962 0 -1 4202560 25 0 0 0 31 0 0 0 16 0 22 0 511074285 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506501517 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28994/tid=29037] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29037/stat : 29037 (java) S 28992 28994 28962 0 -1 4202560 14 0 0 0 0 0 0 0 15 0 22 0 511074285 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29038] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29038/stat : 29038 (java) S 28992 28994 28962 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 511074285 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29039] ppid=28992 vsize=15714952 CPUtime=0.2 cores=0,2,4,6
/proc/28994/task/29039/stat : 29039 (java) R 28992 28994 28962 0 -1 4202560 7 0 0 0 20 0 0 0 16 0 22 0 511074285 16092110848 53185 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506500759 0 4 0 16800975 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.98
Current children cumulated vsize (KiB) 15714952

[startup+6.30128 s]
/proc/loadavg: 6.30 7.63 7.82 9/220 29043
/proc/meminfo: memFree=20817948/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15714952 CPUtime=17.15 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 216611 0 1 0 1684 31 0 0 23 0 22 0 511074209 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3928738 203499 2278 9 0 3919457 0
[pid=28994/tid=28996] ppid=28992 vsize=15714952 CPUtime=2.69 cores=0,2,4,6
/proc/28994/task/28996/stat : 28996 (java) S 28992 28994 28962 0 -1 4202560 35708 0 1 0 264 5 0 0 21 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=28997] ppid=28992 vsize=15714952 CPUtime=0.09 cores=0,2,4,6
/proc/28994/task/28997/stat : 28997 (java) S 28992 28994 28962 0 -1 4202560 19659 0 0 0 7 2 0 0 16 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=28998] ppid=28992 vsize=15714952 CPUtime=0.03 cores=0,2,4,6
/proc/28994/task/28998/stat : 28998 (java) S 28992 28994 28962 0 -1 4202560 6574 0 0 0 3 0 0 0 15 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=28999] ppid=28992 vsize=15714952 CPUtime=0.05 cores=0,2,4,6
/proc/28994/task/28999/stat : 28999 (java) S 28992 28994 28962 0 -1 4202560 9205 0 0 0 4 1 0 0 16 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29000] ppid=28992 vsize=15714952 CPUtime=0.03 cores=0,2,4,6
/proc/28994/task/29000/stat : 29000 (java) S 28992 28994 28962 0 -1 4202560 6393 0 0 0 3 0 0 0 15 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29001] ppid=28992 vsize=15714952 CPUtime=0.09 cores=0,2,4,6
/proc/28994/task/29001/stat : 29001 (java) S 28992 28994 28962 0 -1 4202560 13472 0 0 0 7 2 0 0 16 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29002] ppid=28992 vsize=15714952 CPUtime=0.02 cores=0,2,4,6
/proc/28994/task/29002/stat : 29002 (java) S 28992 28994 28962 0 -1 4202560 3253 0 0 0 2 0 0 0 15 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29003] ppid=28992 vsize=15714952 CPUtime=0.04 cores=0,2,4,6
/proc/28994/task/29003/stat : 29003 (java) S 28992 28994 28962 0 -1 4202560 8650 0 0 0 3 1 0 0 16 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29004] ppid=28992 vsize=15714952 CPUtime=0.08 cores=0,2,4,6
/proc/28994/task/29004/stat : 29004 (java) S 28992 28994 28962 0 -1 4202560 16682 0 0 0 7 1 0 0 16 0 22 0 511074210 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29005] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29005/stat : 29005 (java) S 28992 28994 28962 0 -1 4202560 541 0 0 0 0 0 0 0 15 0 22 0 511074211 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 0 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29006] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29006/stat : 29006 (java) S 28992 28994 28962 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29007] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29007/stat : 29007 (java) S 28992 28994 28962 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29008] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29008/stat : 29008 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738228657 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29009] ppid=28992 vsize=15714952 CPUtime=0.9 cores=0,2,4,6
/proc/28994/task/29009/stat : 29009 (java) S 28992 28994 28962 0 -1 4202560 5600 0 0 0 89 1 0 0 15 0 22 0 511074214 16092110848 203499 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0

################
# More data... #
################

/proc/meminfo: memFree=9306776/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15714952 CPUtime=4470.92 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 1856735 0 1 0 446778 314 0 0 23 0 22 0 511074209 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3928738 1513523 2299 9 0 3919457 0
[pid=28994/tid=28996] ppid=28992 vsize=15714952 CPUtime=2.69 cores=0,2,4,6
/proc/28994/task/28996/stat : 28996 (java) S 28992 28994 28962 0 -1 4202560 35708 0 1 0 264 5 0 0 21 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=28997] ppid=28992 vsize=15714952 CPUtime=2.84 cores=0,2,4,6
/proc/28994/task/28997/stat : 28997 (java) S 28992 28994 28962 0 -1 4202560 171048 0 0 0 254 30 0 0 15 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=28998] ppid=28992 vsize=15714952 CPUtime=2.9 cores=0,2,4,6
/proc/28994/task/28998/stat : 28998 (java) S 28992 28994 28962 0 -1 4202560 158364 0 0 0 264 26 0 0 16 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=28999] ppid=28992 vsize=15714952 CPUtime=2.91 cores=0,2,4,6
/proc/28994/task/28999/stat : 28999 (java) S 28992 28994 28962 0 -1 4202560 135907 0 0 0 268 23 0 0 15 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29000] ppid=28992 vsize=15714952 CPUtime=2.94 cores=0,2,4,6
/proc/28994/task/29000/stat : 29000 (java) S 28992 28994 28962 0 -1 4202560 163898 0 0 0 264 30 0 0 16 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29001] ppid=28992 vsize=15714952 CPUtime=3.48 cores=0,2,4,6
/proc/28994/task/29001/stat : 29001 (java) S 28992 28994 28962 0 -1 4202560 193056 0 0 0 316 32 0 0 16 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29002] ppid=28992 vsize=15714952 CPUtime=3.33 cores=0,2,4,6
/proc/28994/task/29002/stat : 29002 (java) S 28992 28994 28962 0 -1 4202560 188999 0 0 0 298 35 0 0 15 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29003] ppid=28992 vsize=15714952 CPUtime=3.18 cores=0,2,4,6
/proc/28994/task/29003/stat : 29003 (java) S 28992 28994 28962 0 -1 4202560 146441 0 0 0 291 27 0 0 16 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29004] ppid=28992 vsize=15714952 CPUtime=3.19 cores=0,2,4,6
/proc/28994/task/29004/stat : 29004 (java) S 28992 28994 28962 0 -1 4202560 209410 0 0 0 284 35 0 0 15 0 22 0 511074210 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29005] ppid=28992 vsize=15714952 CPUtime=1.16 cores=0,2,4,6
/proc/28994/task/29005/stat : 29005 (java) S 28992 28994 28962 0 -1 4202560 84097 0 0 0 103 13 0 0 15 0 22 0 511074211 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 0 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29006] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29006/stat : 29006 (java) S 28992 28994 28962 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29007] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29007/stat : 29007 (java) S 28992 28994 28962 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29008] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29008/stat : 29008 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738228657 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29009] ppid=28992 vsize=15714952 CPUtime=1.14 cores=0,2,4,6
/proc/28994/task/29009/stat : 29009 (java) S 28992 28994 28962 0 -1 4202560 6450 0 0 0 113 1 0 0 16 0 22 0 511074214 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29010] ppid=28992 vsize=15714952 CPUtime=2.67 cores=0,2,4,6
/proc/28994/task/29010/stat : 29010 (java) S 28992 28994 28962 0 -1 4202560 19290 0 0 0 265 2 0 0 15 0 22 0 511074214 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29011] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29011/stat : 29011 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29012] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29012/stat : 29012 (java) S 28992 28994 28962 0 -1 4202560 66 0 0 0 0 0 0 0 15 0 22 0 511074214 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29036] ppid=28992 vsize=15714952 CPUtime=1110.83 cores=0,2,4,6
/proc/28994/task/29036/stat : 29036 (java) R 28992 28994 28962 0 -1 4202560 80150 0 0 0 111074 9 0 0 25 0 22 0 511074285 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506430310 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28994/tid=29037] ppid=28992 vsize=15714952 CPUtime=1110.12 cores=0,2,4,6
/proc/28994/task/29037/stat : 29037 (java) R 28992 28994 28962 0 -1 4202560 92734 0 0 0 111000 12 0 0 25 0 22 0 511074285 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912505794048 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28994/tid=29038] ppid=28992 vsize=15714952 CPUtime=1109.87 cores=0,2,4,6
/proc/28994/task/29038/stat : 29038 (java) R 28992 28994 28962 0 -1 4202560 63833 0 0 0 110978 9 0 0 25 0 22 0 511074285 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912505810895 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28994/tid=29039] ppid=28992 vsize=15714952 CPUtime=1107.49 cores=0,2,4,6
/proc/28994/task/29039/stat : 29039 (java) R 28992 28994 28962 0 -1 4202560 105899 0 0 0 110734 15 0 0 25 0 22 0 511074285 16092110848 1513523 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506038014 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4470.92
Current children cumulated vsize (KiB) 15714952

[startup+1182.3 s]
/proc/loadavg: 8.29 8.12 8.02 9/220 29075
/proc/meminfo: memFree=9454432/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15714952 CPUtime=4710.33 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 1875200 0 1 0 470715 318 0 0 23 0 22 0 511074209 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3928738 1473332 2299 9 0 3919457 0
[pid=28994/tid=28996] ppid=28992 vsize=15714952 CPUtime=2.69 cores=0,2,4,6
/proc/28994/task/28996/stat : 28996 (java) S 28992 28994 28962 0 -1 4202560 35708 0 1 0 264 5 0 0 21 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=28997] ppid=28992 vsize=15714952 CPUtime=3.02 cores=0,2,4,6
/proc/28994/task/28997/stat : 28997 (java) S 28992 28994 28962 0 -1 4202560 172959 0 0 0 271 31 0 0 16 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=28998] ppid=28992 vsize=15714952 CPUtime=2.98 cores=0,2,4,6
/proc/28994/task/28998/stat : 28998 (java) S 28992 28994 28962 0 -1 4202560 158419 0 0 0 272 26 0 0 15 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=28999] ppid=28992 vsize=15714952 CPUtime=3.05 cores=0,2,4,6
/proc/28994/task/28999/stat : 28999 (java) S 28992 28994 28962 0 -1 4202560 137407 0 0 0 282 23 0 0 15 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29000] ppid=28992 vsize=15714952 CPUtime=3.11 cores=0,2,4,6
/proc/28994/task/29000/stat : 29000 (java) S 28992 28994 28962 0 -1 4202560 167953 0 0 0 280 31 0 0 16 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29001] ppid=28992 vsize=15714952 CPUtime=3.64 cores=0,2,4,6
/proc/28994/task/29001/stat : 29001 (java) S 28992 28994 28962 0 -1 4202560 195206 0 0 0 332 32 0 0 15 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29002] ppid=28992 vsize=15714952 CPUtime=3.48 cores=0,2,4,6
/proc/28994/task/29002/stat : 29002 (java) S 28992 28994 28962 0 -1 4202560 193232 0 0 0 312 36 0 0 15 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29003] ppid=28992 vsize=15714952 CPUtime=3.32 cores=0,2,4,6
/proc/28994/task/29003/stat : 29003 (java) S 28992 28994 28962 0 -1 4202560 147327 0 0 0 305 27 0 0 16 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29004] ppid=28992 vsize=15714952 CPUtime=3.31 cores=0,2,4,6
/proc/28994/task/29004/stat : 29004 (java) S 28992 28994 28962 0 -1 4202560 212932 0 0 0 296 35 0 0 16 0 22 0 511074210 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29005] ppid=28992 vsize=15714952 CPUtime=1.23 cores=0,2,4,6
/proc/28994/task/29005/stat : 29005 (java) S 28992 28994 28962 0 -1 4202560 84232 0 0 0 109 14 0 0 15 0 22 0 511074211 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 0 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29006] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29006/stat : 29006 (java) S 28992 28994 28962 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29007] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29007/stat : 29007 (java) S 28992 28994 28962 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29008] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29008/stat : 29008 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738228657 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29009] ppid=28992 vsize=15714952 CPUtime=1.14 cores=0,2,4,6
/proc/28994/task/29009/stat : 29009 (java) S 28992 28994 28962 0 -1 4202560 6450 0 0 0 113 1 0 0 16 0 22 0 511074214 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29010] ppid=28992 vsize=15714952 CPUtime=2.67 cores=0,2,4,6
/proc/28994/task/29010/stat : 29010 (java) S 28992 28994 28962 0 -1 4202560 19290 0 0 0 265 2 0 0 15 0 22 0 511074214 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29011] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29011/stat : 29011 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29012] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29012/stat : 29012 (java) S 28992 28994 28962 0 -1 4202560 68 0 0 0 0 0 0 0 15 0 22 0 511074214 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29036] ppid=28992 vsize=15714952 CPUtime=1170.43 cores=0,2,4,6
/proc/28994/task/29036/stat : 29036 (java) R 28992 28994 28962 0 -1 4202560 80155 0 0 0 117034 9 0 0 25 0 22 0 511074285 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 47198099780268 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=28994/tid=29037] ppid=28992 vsize=15714952 CPUtime=1169.46 cores=0,2,4,6
/proc/28994/task/29037/stat : 29037 (java) R 28992 28994 28962 0 -1 4202560 92737 0 0 0 116934 12 0 0 25 0 22 0 511074285 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506049677 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28994/tid=29038] ppid=28992 vsize=15714952 CPUtime=1169.5 cores=0,2,4,6
/proc/28994/task/29038/stat : 29038 (java) R 28992 28994 28962 0 -1 4202560 63836 0 0 0 116941 9 0 0 25 0 22 0 511074285 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506110510 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28994/tid=29039] ppid=28992 vsize=15714952 CPUtime=1167.12 cores=0,2,4,6
/proc/28994/task/29039/stat : 29039 (java) R 28992 28994 28962 0 -1 4202560 105904 0 0 0 116697 15 0 0 25 0 22 0 511074285 16092110848 1473332 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506335032 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4710.33
Current children cumulated vsize (KiB) 15714952



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.8 s]
/proc/loadavg: 8.21 8.11 8.02 9/220 29075
/proc/meminfo: memFree=9301144/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=15714952 CPUtime=4800.19 cores=0,2,4,6
/proc/28994/stat : 28994 (java) S 28992 28994 28962 0 -1 4202496 1914422 0 1 0 479695 324 0 0 23 0 22 0 511074209 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738207717 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 3928738 1512504 2299 9 0 3919457 0
[pid=28994/tid=28996] ppid=28992 vsize=15714952 CPUtime=2.69 cores=0,2,4,6
/proc/28994/task/28996/stat : 28996 (java) S 28992 28994 28962 0 -1 4202560 35708 0 1 0 264 5 0 0 21 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=28997] ppid=28992 vsize=15714952 CPUtime=3.05 cores=0,2,4,6
/proc/28994/task/28997/stat : 28997 (java) S 28992 28994 28962 0 -1 4202560 174817 0 0 0 274 31 0 0 15 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=28998] ppid=28992 vsize=15714952 CPUtime=3.03 cores=0,2,4,6
/proc/28994/task/28998/stat : 28998 (java) S 28992 28994 28962 0 -1 4202560 161416 0 0 0 276 27 0 0 16 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=28999] ppid=28992 vsize=15714952 CPUtime=3.09 cores=0,2,4,6
/proc/28994/task/28999/stat : 28999 (java) S 28992 28994 28962 0 -1 4202560 140888 0 0 0 285 24 0 0 16 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29000] ppid=28992 vsize=15714952 CPUtime=3.14 cores=0,2,4,6
/proc/28994/task/29000/stat : 29000 (java) S 28992 28994 28962 0 -1 4202560 172233 0 0 0 283 31 0 0 16 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29001] ppid=28992 vsize=15714952 CPUtime=3.68 cores=0,2,4,6
/proc/28994/task/29001/stat : 29001 (java) S 28992 28994 28962 0 -1 4202560 197136 0 0 0 335 33 0 0 15 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29002] ppid=28992 vsize=15714952 CPUtime=3.56 cores=0,2,4,6
/proc/28994/task/29002/stat : 29002 (java) S 28992 28994 28962 0 -1 4202560 198821 0 0 0 319 37 0 0 16 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29003] ppid=28992 vsize=15714952 CPUtime=3.37 cores=0,2,4,6
/proc/28994/task/29003/stat : 29003 (java) S 28992 28994 28962 0 -1 4202560 150952 0 0 0 309 28 0 0 15 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29004] ppid=28992 vsize=15714952 CPUtime=3.33 cores=0,2,4,6
/proc/28994/task/29004/stat : 29004 (java) S 28992 28994 28962 0 -1 4202560 214677 0 0 0 297 36 0 0 15 0 22 0 511074210 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29005] ppid=28992 vsize=15714952 CPUtime=1.24 cores=0,2,4,6
/proc/28994/task/29005/stat : 29005 (java) S 28992 28994 28962 0 -1 4202560 84397 0 0 0 109 15 0 0 15 0 22 0 511074211 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 0 0 16800975 18446604453924087936 0 0 -1 4 0 0 0
[pid=28994/tid=29006] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29006/stat : 29006 (java) S 28992 28994 28962 0 -1 4202560 17 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29007] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29007/stat : 29007 (java) S 28992 28994 28962 0 -1 4202560 8 0 0 0 0 0 0 0 16 0 22 0 511074212 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 2 0 0 0
[pid=28994/tid=29008] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29008/stat : 29008 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738228657 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29009] ppid=28992 vsize=15714952 CPUtime=1.14 cores=0,2,4,6
/proc/28994/task/29009/stat : 29009 (java) S 28992 28994 28962 0 -1 4202560 6450 0 0 0 113 1 0 0 16 0 22 0 511074214 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29010] ppid=28992 vsize=15714952 CPUtime=2.67 cores=0,2,4,6
/proc/28994/task/29010/stat : 29010 (java) S 28992 28994 28962 0 -1 4202560 19290 0 0 0 265 2 0 0 15 0 22 0 511074214 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29011] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29011/stat : 29011 (java) S 28992 28994 28962 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 511074214 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738220953 0 4 0 16800975 18446604453924087936 0 0 -1 6 0 0 0
[pid=28994/tid=29012] ppid=28992 vsize=15714952 CPUtime=0 cores=0,2,4,6
/proc/28994/task/29012/stat : 29012 (java) S 28992 28994 28962 0 -1 4202560 70 0 0 0 0 0 0 0 15 0 22 0 511074214 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 264738221568 0 4 0 16800975 18446604453924087936 0 0 -1 0 0 0 0
[pid=28994/tid=29036] ppid=28992 vsize=15714952 CPUtime=1192.85 cores=0,2,4,6
/proc/28994/task/29036/stat : 29036 (java) R 28992 28994 28962 0 -1 4202560 82036 0 0 0 119275 10 0 0 25 0 22 0 511074285 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 18446744073699066094 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=28994/tid=29037] ppid=28992 vsize=15714952 CPUtime=1191.75 cores=0,2,4,6
/proc/28994/task/29037/stat : 29037 (java) R 28992 28994 28962 0 -1 4202560 96923 0 0 0 119162 13 0 0 25 0 22 0 511074285 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506301886 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=28994/tid=29038] ppid=28992 vsize=15714952 CPUtime=1191.93 cores=0,2,4,6
/proc/28994/task/29038/stat : 29038 (java) R 28992 28994 28962 0 -1 4202560 67889 0 0 0 119182 11 0 0 25 0 22 0 511074285 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912506335027 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=28994/tid=29039] ppid=28992 vsize=15714952 CPUtime=1189.54 cores=0,2,4,6
/proc/28994/task/29039/stat : 29039 (java) R 28992 28994 28962 0 -1 4202560 109334 0 0 0 118939 15 0 0 25 0 22 0 511074285 16092110848 1512504 33554432000 1073741824 1073778376 140735516567056 18446744073709551615 46912505926902 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 15714952

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205 s]
/proc/loadavg: 8.21 8.11 8.02 9/220 29075
/proc/meminfo: memFree=9301144/32951124 swapFree=67111524/67111528
[pid=28994] ppid=28992 vsize=0 CPUtime=4800.41 cores=0,2,4,6
/proc/28994/stat : 28994 (java) Z 28992 28994 28962 0 -1 4203548 1914449 0 1 0 479698 343 0 0 17 0 2 0 511074209 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/28994/statm: 0 0 0 0 0 0 0
[pid=28994/tid=29039] ppid=28992 vsize=0 CPUtime=1189.73 cores=0,2,4,6
/proc/28994/task/29039/stat : 29039 (java) R 28992 28994 28962 0 -1 4203588 109334 0 0 0 118940 33 0 0 25 0 2 0 511074285 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1205.06
CPU time (s): 4800.47
CPU user time (s): 4796.99
CPU system time (s): 3.48647
CPU usage (%): 398.361
Max. virtual memory (cumulated for all children) (KiB): 15717768

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.99
system time used= 3.48647
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1914449
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 33847
involuntary context switches= 56267

runsolver used 1.9997 second user time and 4.6233 second system time

The end

Launcher Data 

Begin job on node141 at 2011-04-30 20:03:06
IDJOB=3312247
IDBENCH=84223
IDSOLVER=1698
FILE ID=node141/3312247-1304186586
RUNJOBID= node141-1304186586-28980
PBS_JOBID= 13172491
Free space on /tmp= 72596 MiB

SOLVER NAME= STRUCTure 0.1 (hbr=2)
BENCH NAME= SAT03/industrial/li/li-exam/li-exam-61.shuffled-as.sat03-366.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME -hbr 2
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312247-1304186586/watcher-3312247-1304186586 -o /tmp/evaluation-result-3312247-1304186586/solver-3312247-1304186586 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312247-1304186586.cnf -hbr 2

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3be662940f394fa876137a905247d755
RANDOM SEED=1054429857

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21971992 kB
Buffers:       1412404 kB
Cached:        8924204 kB
SwapCached:          4 kB
Active:        2667596 kB
Inactive:      7735320 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21971992 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            7204 kB
Writeback:           0 kB
AnonPages:       66540 kB
Mapped:          14636 kB
Slab:           511432 kB
PageTables:       5000 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188836 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72592 MiB
End job on node141 at 2011-04-30 20:23:13