Trace number 3249147

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.24 1201.71

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-6x34.cnf
MD5SUM1633295f58c28a5b4150be8640bdf9df
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables816
Number of clauses35088
Sum of the clauses size137904
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21224
Number of clauses of size 30
Number of clauses of size 433864
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3249147-1304083266/watcher-3249147-1304083266 -o /tmp/evaluation-result-3249147-1304083266/solver-3249147-1304083266 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3249147-1304083266.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.83 7.41 7.79 5/181 4130
/proc/meminfo: memFree=26721804/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) R 4128 4130 3322 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0

[startup+0.269461 s]
/proc/loadavg: 6.83 7.41 7.79 5/181 4130
/proc/meminfo: memFree=26721804/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300455 s]
/proc/loadavg: 6.83 7.41 7.79 5/181 4130
/proc/meminfo: memFree=26721804/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 24 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.400438 s]
/proc/loadavg: 6.83 7.41 7.79 5/181 4130
/proc/meminfo: memFree=26721804/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 23 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700386 s]
/proc/loadavg: 6.83 7.41 7.79 5/181 4130
/proc/meminfo: memFree=26721804/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 20 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50125 s]
/proc/loadavg: 6.83 7.41 7.79 11/187 4136
/proc/meminfo: memFree=26674376/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1177844 CPUtime=1.49 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 9578 0 0 0 149 0 0 0 25 0 1 0 519925104 1206112256 4528 33554432000 4194304 4587354 140735097393888 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 294461 4528 337 96 0 291023 0
[pid=4132] ppid=4130 vsize=25464 CPUtime=1.48 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 3981 0 0 0 148 0 0 0 25 0 1 0 519925104 26075136 3707 33554432000 4194304 4785740 140733344217168 18446744073709551615 210204344075 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 6366 3707 340 145 0 3411 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=0.74 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 74 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=7708 CPUtime=1.49 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 2264 0 0 0 149 0 0 0 25 0 1 0 519925104 7892992 1089 33554432000 4194304 4352236 140736953136464 18446744073709551615 4208824 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 1927 1089 127 39 0 1007 0
[pid=4135] ppid=4130 vsize=15312 CPUtime=0.73 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 5086 0 0 0 73 0 0 0 25 0 1 0 519925104 15679488 1719 33554432000 4194304 4331988 140736941327680 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 3828 1719 173 34 0 2270 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 1703644

[startup+3.10099 s]
/proc/loadavg: 6.83 7.41 7.79 11/187 4136
/proc/meminfo: memFree=26659992/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1188688 CPUtime=3.09 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 13692 0 0 0 308 1 0 0 25 0 1 0 519925104 1217216512 7279 33554432000 4194304 4587354 140735097393888 18446744073709551615 4238406 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 297172 7279 337 96 0 293734 0
[pid=4132] ppid=4130 vsize=28840 CPUtime=3.08 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 4810 0 0 0 308 0 0 0 25 0 1 0 519925104 29532160 4536 33554432000 4194304 4785740 140733344217168 18446744073709551615 4549791 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 7210 4536 340 145 0 4255 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=1.54 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 154 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=10532 CPUtime=3.09 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 3098 0 0 0 309 0 0 0 25 0 1 0 519925104 10784768 1795 33554432000 4194304 4352236 140736953136464 18446744073709551615 4331538 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 2633 1795 127 39 0 1713 0
[pid=4135] ppid=4130 vsize=15312 CPUtime=1.52 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 5086 0 0 0 152 0 0 0 25 0 1 0 519925104 15679488 1719 33554432000 4194304 4331988 140736941327680 18446744073709551615 4299275 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 3828 1719 173 34 0 2270 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 1720688

[startup+6.30045 s]
/proc/loadavg: 7.00 7.44 7.80 11/187 4136
/proc/meminfo: memFree=26646828/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1179144 CPUtime=6.29 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 17912 0 0 0 628 1 0 0 25 0 1 0 519925104 1207443456 7045 33554432000 4194304 4587354 140735097393888 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 294786 7045 337 96 0 291348 0
[pid=4132] ppid=4130 vsize=32940 CPUtime=6.29 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 5778 0 0 0 628 1 0 0 25 0 1 0 519925104 33730560 5504 33554432000 4194304 4785740 140733344217168 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 8235 5504 340 145 0 5280 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=3.14 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 314 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=10664 CPUtime=6.29 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 3834 0 0 0 629 0 0 0 25 0 1 0 519925104 10919936 1859 33554432000 4194304 4352236 140736953136464 18446744073709551615 4328505 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 2666 1859 127 39 0 1746 0
[pid=4135] ppid=4130 vsize=15312 CPUtime=3.1 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 5086 0 0 0 310 0 0 0 25 0 1 0 519925104 15679488 1719 33554432000 4194304 4331988 140736941327680 18446744073709551615 4210418 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 3828 1719 173 34 0 2270 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 1715376

[startup+12.7004 s]
/proc/loadavg: 7.24 7.48 7.81 11/187 4136
/proc/meminfo: memFree=26627380/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1204176 CPUtime=12.69 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 27568 0 0 0 1267 2 0 0 25 0 1 0 519925104 1233076224 10842 33554432000 4194304 4587354 140735097393888 18446744073709551615 4238435 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 301044 10842 337 96 0 297606 0
[pid=4132] ppid=4130 vsize=38724 CPUtime=12.68 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 7160 0 0 0 1267 1 0 0 25 0 1 0 519925104 39653376 6886 33554432000 4194304 4785740 140733344217168 18446744073709551615 4286976 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 9681 6886 340 145 0 6726 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=6.31 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 631 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=11648 CPUtime=12.68 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 5117 0 0 0 1268 0 0 0 25 0 1 0 519925104 11927552 2106 33554432000 4194304 4352236 140736953136464 18446744073709551615 4276591 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 2912 2106 127 39 0 1992 0
[pid=4135] ppid=4130 vsize=16336 CPUtime=6.3 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 5313 0 0 0 630 0 0 0 25 0 1 0 519925104 16728064 1946 33554432000 4194304 4331988 140736941327680 18446744073709551615 4299840 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 4084 1946 173 34 0 2526 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 1748200

[startup+25.5062 s]
/proc/loadavg: 7.78 7.59 7.84 10/187 4137
/proc/meminfo: memFree=26610020/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1204968 CPUtime=25.5 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 51815 0 0 0 2543 7 0 0 25 0 1 0 519925104 1233887232 12396 33554432000 4194304 4587354 140735097393888 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 301242 12396 337 96 0 297804 0
[pid=4132] ppid=4130 vsize=43672 CPUtime=25.49 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 8358 0 0 0 2548 1 0 0 25 0 1 0 519925104 44720128 8084 33554432000 4194304 4785740 140733344217168 18446744073709551615 4309691 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 10918 8084 340 145 0 7963 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=12.65 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 1265 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=12288 CPUtime=25.49 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 6813 0 0 0 2549 0 0 0 25 0 1 0 519925104 12582912 2266 33554432000 4194304 4352236 140736953136464 18446744073709551615 4268080 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 3072 2266 127 39 0 2152 0
[pid=4135] ppid=4130 vsize=18764 CPUtime=12.7 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 5698 0 0 0 1270 0 0 0 25 0 1 0 519925104 19214336 2331 33554432000 4194304 4331988 140736941327680 18446744073709551615 4265493 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 4691 2331 174 34 0 3133 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 1757008

[startup+51.101 s]
/proc/loadavg: 8.19 7.70 7.87 11/187 4137
/proc/meminfo: memFree=26558692/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=81884 CPUtime=51.09 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 90956 0 0 0 5095 14 0 0 25 0 1 0 519925104 83849216 16141 33554432000 4194304 4587354 140735097393888 18446744073709551615 4238654 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 20471 16141 337 96 0 17033 0
[pid=4132] ppid=4130 vsize=54772 CPUtime=51.08 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 10908 0 0 0 5106 2 0 0 25 0 1 0 519925104 56086528 10634 33554432000 4194304 4785740 140733344217168 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 13693 10634 340 145 0 10738 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=25.41 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 2541 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=13696 CPUtime=51.08 cores=2

################
# More data... #
################

/proc/4135/statm: 10377 7042 174 34 0 8819 0
Current children cumulated CPU time (s) 3764.04
Current children cumulated vsize (KiB) 798148

[startup+1002.31 s]
/proc/loadavg: 5.12 5.46 6.58 6/177 4181
/proc/meminfo: memFree=26847560/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1249576 CPUtime=1002.31 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 831939 0 0 0 100014 217 0 0 25 0 1 0 519925104 1279565824 23256 33554432000 4194304 4587354 140735097393888 18446744073709551615 210204343956 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 312394 23256 337 96 0 308956 0
[pid=4132] ppid=4130 vsize=135124 CPUtime=1002.26 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 29171 0 0 0 100219 7 0 0 25 0 1 0 519925104 138366976 28897 33554432000 4194304 4785740 140733344217168 18446744073709551615 4277627 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 33781 28897 340 145 0 30826 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=498.47 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 49847 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 11737467 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=30568 CPUtime=1002.31 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 69527 0 0 0 100223 8 0 0 25 0 1 0 519925104 31301632 6804 33554432000 4194304 4352236 140736953136464 18446744073709551615 4271308 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 7642 6804 127 39 0 6722 0
[pid=4135] ppid=4130 vsize=41508 CPUtime=498.38 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 10409 0 0 0 49835 3 0 0 25 0 1 0 519925104 42504192 7042 33554432000 4194304 4331988 140736941327680 18446744073709551615 4265477 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 10377 7042 174 34 0 8819 0
Current children cumulated CPU time (s) 4003.73
Current children cumulated vsize (KiB) 1934092

[startup+1062.3 s]
/proc/loadavg: 5.08 5.39 6.48 6/177 4182
/proc/meminfo: memFree=26823752/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1249060 CPUtime=1062.3 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 872423 0 0 0 106003 227 0 0 25 0 1 0 519925104 1279037440 28957 33554432000 4194304 4587354 140735097393888 18446744073709551615 4238522 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 312265 28957 337 96 0 308827 0
[pid=4132] ppid=4130 vsize=141764 CPUtime=1062.25 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 30648 0 0 0 106218 7 0 0 25 0 1 0 519925104 145166336 30374 33554432000 4194304 4785740 140733344217168 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 35441 30374 340 145 0 32486 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=528.29 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 52829 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=25704 CPUtime=1062.3 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 71095 0 0 0 106222 8 0 0 25 0 1 0 519925104 26320896 5588 33554432000 4194304 4352236 140736953136464 18446744073709551615 4278717 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 6426 5588 127 39 0 5506 0
[pid=4135] ppid=4130 vsize=41508 CPUtime=528.23 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 10409 0 0 0 52820 3 0 0 25 0 1 0 519925104 42504192 7042 33554432000 4194304 4331988 140736941327680 18446744073709551615 4263162 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 10377 7042 174 34 0 8819 0
Current children cumulated CPU time (s) 4243.37
Current children cumulated vsize (KiB) 1935352

[startup+1122.3 s]
/proc/loadavg: 5.11 5.34 6.40 6/177 4184
/proc/meminfo: memFree=26834416/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1250188 CPUtime=1122.3 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 916206 0 0 0 111988 242 0 0 25 0 1 0 519925104 1280192512 25458 33554432000 4194304 4587354 140735097393888 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 312547 25458 337 96 0 309109 0
[pid=4132] ppid=4130 vsize=144312 CPUtime=1122.25 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 31220 0 0 0 112218 7 0 0 25 0 1 0 519925104 147775488 30946 33554432000 4194304 4785740 140733344217168 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 36078 30946 340 145 0 33123 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=558.16 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 55816 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528266 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=26220 CPUtime=1122.31 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 76152 0 0 0 112222 9 0 0 25 0 1 0 519925104 26849280 5717 33554432000 4194304 4352236 140736953136464 18446744073709551615 4328109 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 6555 5717 127 39 0 5635 0
[pid=4135] ppid=4130 vsize=41508 CPUtime=558.03 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 10409 0 0 0 55800 3 0 0 25 0 1 0 519925104 42504192 7042 33554432000 4194304 4331988 140736941327680 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 10377 7042 174 34 0 8819 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 1939544

[startup+1182.3 s]
/proc/loadavg: 5.07 5.29 6.31 6/177 4185
/proc/meminfo: memFree=26816312/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1249684 CPUtime=1182.31 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 955923 0 0 0 117977 254 0 0 25 0 1 0 519925104 1279676416 28937 33554432000 4194304 4587354 140735097393888 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 312421 28937 337 96 0 308983 0
[pid=4132] ppid=4130 vsize=147176 CPUtime=1182.25 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 31904 0 0 0 118218 7 0 0 25 0 1 0 519925104 150708224 31630 33554432000 4194304 4785740 140733344217168 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 36794 31630 340 145 0 33839 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=587.95 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 58795 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134530344 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=29420 CPUtime=1182.3 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 81272 0 0 0 118221 9 0 0 25 0 1 0 519925104 30126080 6517 33554432000 4194304 4352236 140736953136464 18446744073709551615 4328839 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 7355 6517 127 39 0 6435 0
[pid=4135] ppid=4130 vsize=41508 CPUtime=587.91 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 10409 0 0 0 58788 3 0 0 25 0 1 0 519925104 42504192 7042 33554432000 4194304 4331988 140736941327680 18446744073709551615 4228343 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 10377 7042 174 34 0 8819 0
Current children cumulated CPU time (s) 4722.72
Current children cumulated vsize (KiB) 1945104



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 5.19 5.31 6.29 6/177 4186
/proc/meminfo: memFree=26811232/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1250324 CPUtime=1201.71 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 968770 0 0 0 119912 259 0 0 25 0 1 0 519925104 1280331776 29451 33554432000 4194304 4587354 140735097393888 18446744073709551615 4239308 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 312581 29451 337 96 0 309143 0
[pid=4132] ppid=4130 vsize=147888 CPUtime=1201.66 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 32051 0 0 0 120159 7 0 0 25 0 1 0 519925104 151437312 31777 33554432000 4194304 4785740 140733344217168 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 36972 31777 340 145 0 34017 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=597.64 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 59764 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=29676 CPUtime=1201.71 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 81336 0 0 0 120162 9 0 0 25 0 1 0 519925104 30388224 6581 33554432000 4194304 4352236 140736953136464 18446744073709551615 4328039 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 7419 6581 127 39 0 6499 0
[pid=4135] ppid=4130 vsize=41508 CPUtime=597.52 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 10409 0 0 0 59749 3 0 0 25 0 1 0 519925104 42504192 7042 33554432000 4194304 4331988 140736941327680 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 10377 7042 174 34 0 8819 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 1946712

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 5.19 5.31 6.29 6/177 4186
/proc/meminfo: memFree=26811232/32951124 swapFree=67088964/67111528
[pid=4130] ppid=4128 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/4130/stat : 4130 (ppfolio) S 4128 4130 3322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 519925104 18763776 389 33554432000 4194304 4287625 140734399494800 18446744073709551615 210204667407 0 0 4096 65536 2892648795839922175 0 0 17 4 0 0 0
/proc/4130/statm: 4581 389 341 23 0 91 0
[pid=4131] ppid=4130 vsize=1250324 CPUtime=1201.71 cores=0
/proc/4131/stat : 4131 (cryptominisat) R 4130 4130 3322 0 -1 4202496 968770 0 0 0 119912 259 0 0 25 0 1 0 519925104 1280331776 29451 33554432000 4194304 4587354 140735097393888 18446744073709551615 4239308 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4131/statm: 312581 29451 337 96 0 309143 0
[pid=4132] ppid=4130 vsize=147888 CPUtime=1201.66 cores=4
/proc/4132/stat : 4132 (clasp) R 4130 4130 3322 0 -1 4202496 32051 0 0 0 120159 7 0 0 25 0 1 0 519925104 151437312 31777 33554432000 4194304 4785740 140733344217168 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4132/statm: 36972 31777 340 145 0 34017 0
[pid=4133] ppid=4130 vsize=458992 CPUtime=597.64 cores=6
/proc/4133/stat : 4133 (TNM) R 4130 4130 3322 0 -1 4202496 1433 0 0 0 59764 0 0 0 25 0 1 0 519925104 470007808 1330 33554432000 134512640 134534564 4286954544 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4133/statm: 114748 1330 95 6 0 113414 0
[pid=4134] ppid=4130 vsize=29676 CPUtime=1201.71 cores=2
/proc/4134/stat : 4134 (lingeling) R 4130 4130 3322 0 -1 4202496 81336 0 0 0 120162 9 0 0 25 0 1 0 519925104 30388224 6581 33554432000 4194304 4352236 140736953136464 18446744073709551615 4328039 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/4134/statm: 7419 6581 127 39 0 6499 0
[pid=4135] ppid=4130 vsize=41508 CPUtime=597.52 cores=6
/proc/4135/stat : 4135 (march_hi) R 4130 4130 3322 0 -1 4202496 10409 0 0 0 59749 3 0 0 25 0 1 0 519925104 42504192 7042 33554432000 4194304 4331988 140736941327680 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/4135/statm: 10377 7042 174 34 0 8819 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 1946712

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4130 and gives
#  childrusage.ru_utime.tv_sec=2396
#  childrusage.ru_utime.tv_usec=760637
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=139978
# CPU time returned by wait4() is 2396.9
# while last known CPU time is 4800.24
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.24
CPU user time (s): 4797.46
CPU system time (s): 2.78
CPU usage (%): 399.45
Max. virtual memory (cumulated for all children) (KiB): 3117284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2396.76
system time used= 0.139978
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 93700
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 400
involuntary context switches= 26257

runsolver used 2.17667 second user time and 4.37533 second system time

The end

Launcher Data 

Begin job on node130 at 2011-04-29 15:21:06
IDJOB=3249147
IDBENCH=83157
IDSOLVER=1612
FILE ID=node130/3249147-1304083266
RUNJOBID= node130-1304076955-3340
PBS_JOBID= 13170506
Free space on /tmp= 71984 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-6x34.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3249147-1304083266/watcher-3249147-1304083266 -o /tmp/evaluation-result-3249147-1304083266/solver-3249147-1304083266 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3249147-1304083266.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1633295f58c28a5b4150be8640bdf9df
RANDOM SEED=1068828649

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26721968 kB
Buffers:       1170488 kB
Cached:        4159308 kB
SwapCached:      22432 kB
Active:         884856 kB
Inactive:      4912228 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26721968 kB
SwapTotal:    67111528 kB
SwapFree:     67088964 kB
Dirty:           10500 kB
Writeback:           0 kB
AnonPages:      444636 kB
Mapped:          16552 kB
Slab:           369272 kB
PageTables:       5824 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1180636 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71984 MiB
End job on node130 at 2011-04-29 15:41:10