Trace number 3289628

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.25 1203.52

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom16.cnf
MD5SUM73a2c2d9e5c062e561bfdb7c82071a99
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables29254
Number of clauses97456
Sum of the clauses size247986
Maximum clause length977
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 250701
Number of clauses of size 346235
Number of clauses of size 4135
Number of clauses of size 514
Number of clauses of size over 5370

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289628-1304081614/watcher-3289628-1304081614 -o /tmp/evaluation-result-3289628-1304081614/solver-3289628-1304081614 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3289628-1304081614.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.58 1.98 2.71 4/174 6892
/proc/meminfo: memFree=16770648/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) R 6887 6890 5255 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0

[startup+0.812827 s]
/proc/loadavg: 1.58 1.98 2.71 4/174 6892
/proc/meminfo: memFree=16770648/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) R 6887 6890 5255 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.921811 s]
/proc/loadavg: 1.58 1.98 2.71 4/174 6892
/proc/meminfo: memFree=16770648/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.0008 s]
/proc/loadavg: 1.58 1.98 2.71 4/174 6892
/proc/meminfo: memFree=16770648/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) R 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.12178 s]
/proc/loadavg: 1.58 1.98 2.71 4/174 6892
/proc/meminfo: memFree=16770648/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) R 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 20 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50072 s]
/proc/loadavg: 1.58 1.98 2.71 4/174 6892
/proc/meminfo: memFree=16770648/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 19 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10045 s]
/proc/loadavg: 2.17 2.10 2.74 11/185 6904
/proc/meminfo: memFree=16542304/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=50348 CPUtime=3.09 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 9764 0 0 0 308 1 0 0 25 0 1 0 519761070 51556352 7924 33554432000 4194304 4587354 140735182738672 18446744073709551615 4245162 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 12587 7924 330 96 0 9149 0
[pid=6895] ppid=6890 vsize=33480 CPUtime=3.09 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 6804 0 0 0 308 1 0 0 25 0 1 0 519761070 34283520 5638 33554432000 4194304 4785740 140736384305760 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 8370 5638 340 145 0 5415 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=1.11 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 111 0 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=12048 CPUtime=3.05 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 3652 0 0 0 305 0 0 0 25 0 1 0 519761071 12337152 2047 33554432000 4194304 4352236 140734230404048 18446744073709551615 4328114 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 3012 2047 127 39 0 2092 0
[pid=6901] ppid=6890 vsize=71584 CPUtime=1.96 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 35821 0 0 0 191 5 0 0 21 0 1 0 519761071 73302016 8995 33554432000 4194304 4331988 140734996120480 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 17896 8995 175 34 0 16338 0
Current children cumulated CPU time (s) 12.3
Current children cumulated vsize (KiB) 648736

[startup+6.30691 s]
/proc/loadavg: 2.17 2.10 2.74 12/185 6904
/proc/meminfo: memFree=16524188/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=941616 CPUtime=6.29 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 11792 0 0 0 627 2 0 0 25 0 1 0 519761070 964214784 8031 33554432000 4194304 4587354 140735182738672 18446744073709551615 4239575 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 235404 8031 336 96 0 231966 0
[pid=6895] ppid=6890 vsize=36516 CPUtime=6.29 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 7570 0 0 0 628 1 0 0 25 0 1 0 519761070 37392384 6404 33554432000 4194304 4785740 140736384305760 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 9129 6404 340 145 0 6174 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=2.71 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 271 0 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=14616 CPUtime=4.68 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 4427 0 0 0 441 27 0 0 25 0 1 0 519761071 14966784 2822 33554432000 4194304 4352236 140734230404048 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 3654 2822 127 39 0 2734 0
[pid=6901] ppid=6890 vsize=72524 CPUtime=3.55 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 36015 0 0 0 350 5 0 0 25 0 1 0 519761071 74264576 9189 33554432000 4194304 4331988 140734996120480 18446744073709551615 4243242 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 18131 9189 175 34 0 16573 0
Current children cumulated CPU time (s) 23.52
Current children cumulated vsize (KiB) 1546548

[startup+12.7008 s]
/proc/loadavg: 2.96 2.26 2.79 12/185 6905
/proc/meminfo: memFree=16487512/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=993604 CPUtime=12.68 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 17109 0 0 0 1265 3 0 0 25 0 1 0 519761070 1017450496 11130 33554432000 4194304 4587354 140735182738672 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 248401 11130 336 96 0 244963 0
[pid=6895] ppid=6890 vsize=41788 CPUtime=12.69 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 8862 0 0 0 1267 2 0 0 25 0 1 0 519761070 42790912 7696 33554432000 4194304 4785740 140736384305760 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 10447 7696 340 145 0 7492 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=5.9 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 590 0 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134528966 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=14616 CPUtime=7.65 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 4427 0 0 0 611 154 0 0 25 0 1 0 519761071 14966784 2822 33554432000 4194304 4352236 140734230404048 18446744073709551615 4276399 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 3654 2822 127 39 0 2734 0
[pid=6901] ppid=6890 vsize=72788 CPUtime=6.7 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 36082 0 0 0 665 5 0 0 25 0 1 0 519761071 74534912 9256 33554432000 4194304 4331988 140734996120480 18446744073709551615 4226235 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 18197 9256 175 34 0 16639 0
Current children cumulated CPU time (s) 45.62
Current children cumulated vsize (KiB) 1604072

[startup+25.5007 s]
/proc/loadavg: 4.57 2.66 2.91 11/185 6905
/proc/meminfo: memFree=16459092/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=984544 CPUtime=25.47 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 23774 0 0 0 2541 6 0 0 25 0 1 0 519761070 1008173056 11195 33554432000 4194304 4587354 140735182738672 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 246136 11195 336 96 0 242698 0
[pid=6895] ppid=6890 vsize=48192 CPUtime=25.48 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 10411 0 0 0 2546 2 0 0 25 0 1 0 519761070 49348608 9245 33554432000 4194304 4785740 140736384305760 18446744073709551615 4546264 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 12048 9245 340 145 0 9093 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=12.23 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 1223 0 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 8558011 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=16404 CPUtime=20.44 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 4874 0 0 0 1890 154 0 0 25 0 1 0 519761071 16797696 3269 33554432000 4194304 4352236 140734230404048 18446744073709551615 4329024 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 4101 3269 127 39 0 3181 0
[pid=6901] ppid=6890 vsize=74452 CPUtime=13.09 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 36598 0 0 0 1304 5 0 0 25 0 1 0 519761071 76238848 9772 33554432000 4194304 4331988 140734996120480 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 18613 9772 175 34 0 17055 0
Current children cumulated CPU time (s) 96.71
Current children cumulated vsize (KiB) 1604868

[startup+51.1004 s]
/proc/loadavg: 6.23 3.20 3.08 11/185 6906
/proc/meminfo: memFree=16414144/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=959520 CPUtime=51.05 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 32791 0 0 0 5096 9 0 0 25 0 1 0 519761070 982548480 12574 33554432000 4194304 4587354 140735182738672 18446744073709551615 4237740 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 239880 12574 336 96 0 236442 0
[pid=6895] ppid=6890 vsize=56324 CPUtime=51.08 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 12397 0 0 0 5105 3 0 0 25 0 1 0 519761070 57675776 11231 33554432000 4194304 4785740 140736384305760 18446744073709551615 4553068 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 14081 11231 340 145 0 11126 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=24.99 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 2499 0 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134529777 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=18756 CPUtime=46.05 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 5462 0 0 0 4450 155 0 0 25 0 1 0 519761071 19206144 3857 33554432000 4194304 4352236 140734230404048 18446744073709551615 4329081 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 4689 3857 127 39 0 3769 0
[pid=6901] ppid=6890 vsize=78800 CPUtime=25.79 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 37516 0 0 0 2573 6 0 0 25 0 1 0 519761071 80691200 10671 33554432000 4194304 4331988 140734996120480 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 19700 10671 175 34 0 18142 0
Current children cumulated CPU time (s) 198.96
Current children cumulated vsize (KiB) 1594676

[startup+102.301 s]
/proc/loadavg: 7.94 4.12 3.40 11/185 6907
/proc/meminfo: memFree=16306796/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=994504 CPUtime=102.22 cores=0

################
# More data... #
################

/proc/6901/statm: 25738 16711 175 34 0 24180 0
Current children cumulated CPU time (s) 3757.18
Current children cumulated vsize (KiB) 1778272

[startup+1002.3 s]
/proc/loadavg: 9.13 8.91 6.96 10/185 6943
/proc/meminfo: memFree=16005848/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=1063520 CPUtime=1001.8 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 186919 0 0 0 100112 68 0 0 25 0 1 0 519761070 1089044480 21976 33554432000 4194304 4587354 140735182738672 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 265880 21976 336 96 0 262442 0
[pid=6895] ppid=6890 vsize=148392 CPUtime=1002.13 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 34590 0 0 0 100201 12 0 0 25 0 1 0 519761070 151953408 33424 33554432000 4194304 4785740 140736384305760 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 37098 33424 340 145 0 34143 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=497.51 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 49724 27 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 8559617 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=46928 CPUtime=997.01 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 49977 0 0 0 99541 160 0 0 25 0 1 0 519761071 48054272 10900 33554432000 4194304 4352236 140734230404048 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 11732 10900 127 39 0 10812 0
[pid=6901] ppid=6890 vsize=114020 CPUtime=498.32 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 43923 0 0 0 49812 20 0 0 25 0 1 0 519761071 116756480 17058 33554432000 4194304 4331988 140734996120480 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 28505 17058 175 34 0 26947 0
Current children cumulated CPU time (s) 3996.77
Current children cumulated vsize (KiB) 1854136

[startup+1062.3 s]
/proc/loadavg: 9.10 8.94 7.08 11/185 6945
/proc/meminfo: memFree=15984152/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=1004768 CPUtime=1061.78 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 191895 0 0 0 106107 71 0 0 25 0 1 0 519761070 1028882432 20875 33554432000 4194304 4587354 140735182738672 18446744073709551615 4243472 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 251192 20875 336 96 0 247754 0
[pid=6895] ppid=6890 vsize=149104 CPUtime=1062.12 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 34743 0 0 0 106200 12 0 0 25 0 1 0 519761070 152682496 33577 33554432000 4194304 4785740 140736384305760 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 37276 33577 340 145 0 34321 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=527.35 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 52707 28 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134528275 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=38736 CPUtime=1057 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 51769 0 0 0 105540 160 0 0 25 0 1 0 519761071 39665664 8852 33554432000 4194304 4352236 140734230404048 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 9684 8852 127 39 0 8764 0
[pid=6901] ppid=6890 vsize=114680 CPUtime=528.13 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 44254 0 0 0 52792 21 0 0 25 0 1 0 519761071 117432320 17389 33554432000 4194304 4331988 140734996120480 18446744073709551615 4265493 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 28670 17389 175 34 0 27112 0
Current children cumulated CPU time (s) 4236.38
Current children cumulated vsize (KiB) 1788564

[startup+1122.3 s]
/proc/loadavg: 9.09 8.96 7.22 11/185 6946
/proc/meminfo: memFree=15983404/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=1037208 CPUtime=1121.76 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 195438 0 0 0 112103 73 0 0 25 0 1 0 519761070 1062100992 18627 33554432000 4194304 4587354 140735182738672 18446744073709551615 4237686 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 259302 18627 336 96 0 255864 0
[pid=6895] ppid=6890 vsize=150248 CPUtime=1122.11 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 35019 0 0 0 112199 12 0 0 25 0 1 0 519761070 153853952 33853 33554432000 4194304 4785740 140736384305760 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 37562 33853 340 145 0 34607 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=557.15 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 55687 28 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=38736 CPUtime=1116.98 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 55865 0 0 0 111538 160 0 0 25 0 1 0 519761071 39665664 8852 33554432000 4194304 4352236 140734230404048 18446744073709551615 4328004 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 9684 8852 127 39 0 8764 0
[pid=6901] ppid=6890 vsize=115352 CPUtime=557.98 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 44701 0 0 0 55776 22 0 0 25 0 1 0 519761071 118120448 17836 33554432000 4194304 4331988 140734996120480 18446744073709551615 4243048 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 28838 17836 175 34 0 27280 0
Current children cumulated CPU time (s) 4475.98
Current children cumulated vsize (KiB) 1822820

[startup+1182.3 s]
/proc/loadavg: 9.08 8.98 7.32 11/185 6948
/proc/meminfo: memFree=15944960/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=1021432 CPUtime=1181.72 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 216157 0 0 0 118096 76 0 0 25 0 1 0 519761070 1045946368 26725 33554432000 4194304 4587354 140735182738672 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 255358 26725 336 96 0 251920 0
[pid=6895] ppid=6890 vsize=151836 CPUtime=1182.11 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 35403 0 0 0 118198 13 0 0 25 0 1 0 519761070 155480064 34237 33554432000 4194304 4785740 140736384305760 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 37959 34237 340 145 0 35004 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=586.97 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 58668 29 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134528206 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=46928 CPUtime=1176.97 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 59961 0 0 0 117536 161 0 0 25 0 1 0 519761071 48054272 10900 33554432000 4194304 4352236 140734230404048 18446744073709551615 4231272 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 11732 10900 127 39 0 10812 0
[pid=6901] ppid=6890 vsize=116452 CPUtime=587.8 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 45254 0 0 0 58757 23 0 0 25 0 1 0 519761071 119246848 18389 33554432000 4194304 4331988 140734996120480 18446744073709551615 4210915 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 29113 18389 175 34 0 27555 0
Current children cumulated CPU time (s) 4715.57
Current children cumulated vsize (KiB) 1817924



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.51 s]
/proc/loadavg: 9.12 9.00 7.37 7/179 6949
/proc/meminfo: memFree=16387312/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=1020756 CPUtime=1202.93 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 216833 0 0 0 120216 77 0 0 25 0 1 0 519761070 1045254144 26309 33554432000 4194304 4587354 140735182738672 18446744073709551615 4237686 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 255189 26309 336 96 0 251751 0
[pid=6895] ppid=6890 vsize=152876 CPUtime=1203.31 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 35654 0 0 0 120318 13 0 0 25 0 1 0 519761070 156545024 34488 33554432000 4194304 4785740 140736384305760 18446744073709551615 4538778 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 38219 34488 340 145 0 35264 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=597.54 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 59725 29 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=48976 CPUtime=1198.17 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 60473 0 0 0 119656 161 0 0 25 0 1 0 519761071 50151424 11412 33554432000 4194304 4352236 140734230404048 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 12244 11412 127 39 0 11324 0
[pid=6901] ppid=6890 vsize=116984 CPUtime=598.3 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 45512 0 0 0 59807 23 0 0 25 0 1 0 519761071 119791616 18647 33554432000 4194304 4331988 140734996120480 18446744073709551615 4210861 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 29246 18647 175 34 0 27688 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 1820868

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.51 s]
/proc/loadavg: 9.12 9.00 7.37 7/179 6949
/proc/meminfo: memFree=16387312/32951132 swapFree=67111524/67111528
[pid=6890] ppid=6887 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/6890/stat : 6890 (ppfolio) S 6887 6890 5255 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519761070 18763776 389 33554432000 4194304 4287625 140736412053008 18446744073709551615 210647166479 0 0 4096 65536 2886921577209790463 0 0 17 4 0 0 0
/proc/6890/statm: 4581 389 341 23 0 91 0
[pid=6893] ppid=6890 vsize=1020756 CPUtime=1202.93 cores=0
/proc/6893/stat : 6893 (cryptominisat) R 6890 6890 5255 0 -1 4202496 216833 0 0 0 120216 77 0 0 25 0 1 0 519761070 1045254144 26309 33554432000 4194304 4587354 140735182738672 18446744073709551615 4237686 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/6893/statm: 255189 26309 336 96 0 251751 0
[pid=6895] ppid=6890 vsize=152876 CPUtime=1203.31 cores=4
/proc/6895/stat : 6895 (clasp) R 6890 6890 5255 0 -1 4202496 35654 0 0 0 120318 13 0 0 25 0 1 0 519761070 156545024 34488 33554432000 4194304 4785740 140736384305760 18446744073709551615 4538778 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/6895/statm: 38219 34488 340 145 0 35264 0
[pid=6897] ppid=6890 vsize=462952 CPUtime=597.54 cores=6
/proc/6897/stat : 6897 (TNM) R 6890 6890 5255 0 -1 4202496 3723 0 0 0 59725 29 0 0 25 0 1 0 519761071 474062848 3620 33554432000 134512640 134534564 4291411216 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6897/statm: 115738 3620 95 6 0 114404 0
[pid=6899] ppid=6890 vsize=48976 CPUtime=1198.17 cores=2
/proc/6899/stat : 6899 (lingeling) R 6890 6890 5255 0 -1 4202496 60473 0 0 0 119656 161 0 0 25 0 1 0 519761071 50151424 11412 33554432000 4194304 4352236 140734230404048 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/6899/statm: 12244 11412 127 39 0 11324 0
[pid=6901] ppid=6890 vsize=116984 CPUtime=598.3 cores=6
/proc/6901/stat : 6901 (march_hi) R 6890 6890 5255 0 -1 4202496 45512 0 0 0 59807 23 0 0 25 0 1 0 519761071 119791616 18647 33554432000 4194304 4331988 140734996120480 18446744073709551615 4210861 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/6901/statm: 29246 18647 175 34 0 27688 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 1820868

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6890 and gives
#  childrusage.ru_utime.tv_sec=1196
#  childrusage.ru_utime.tv_usec=569093
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=623753
# CPU time returned by wait4() is 1198.19
# while last known CPU time is 4800.25
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1203.52
CPU time (s): 4800.25
CPU user time (s): 4797.22
CPU system time (s): 3.03
CPU usage (%): 398.852
Max. virtual memory (cumulated for all children) (KiB): 2656232

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1196.57
system time used= 1.62375
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 60995
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 571
involuntary context switches= 3250

runsolver used 1.85172 second user time and 4.94025 second system time

The end

Launcher Data 

Begin job on node129 at 2011-04-29 14:53:34
IDJOB=3289628
IDBENCH=83130
IDSOLVER=1612
FILE ID=node129/3289628-1304081614
RUNJOBID= node129-1304081614-6873
PBS_JOBID= 13170456
Free space on /tmp= 66368 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom16.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289628-1304081614/watcher-3289628-1304081614 -o /tmp/evaluation-result-3289628-1304081614/solver-3289628-1304081614 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3289628-1304081614.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 73a2c2d9e5c062e561bfdb7c82071a99
RANDOM SEED=1427196869

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      16770844 kB
Buffers:       1281624 kB
Cached:       14169016 kB
SwapCached:          4 kB
Active:        3782236 kB
Inactive:     11732424 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      16770844 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           23468 kB
Writeback:           0 kB
AnonPages:       63276 kB
Mapped:          14892 kB
Slab:           603520 kB
PageTables:       4548 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   185880 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66348 MiB
End job on node129 at 2011-04-29 15:13:40