Trace number 3190817

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.19 1201.71

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1000-c20000-S72635791-098-UNKNOWN.cnf
MD5SUM93976db0d99d3daab756f06103f77642
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark22.9885
Satisfiable
(Un)Satisfiability was proved
Number of variables1000
Number of clauses20000
Sum of the clauses size100000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 520000
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3190817-1304036955/watcher-3190817-1304036955 -o /tmp/evaluation-result-3190817-1304036955/solver-3190817-1304036955 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3190817-1304036955.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.74 8.75 9.65 2/176 3325
/proc/meminfo: memFree=25114216/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) R 3323 3325 2100 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0

[startup+0.920551 s]
/proc/loadavg: 5.74 8.75 9.65 2/176 3325
/proc/meminfo: memFree=25114216/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 23 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.00054 s]
/proc/loadavg: 5.74 8.75 9.65 2/176 3325
/proc/meminfo: memFree=25114216/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 23 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.12051 s]
/proc/loadavg: 5.74 8.75 9.65 2/176 3325
/proc/meminfo: memFree=25114216/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 21 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.2005 s]
/proc/loadavg: 5.74 8.75 9.65 2/176 3325
/proc/meminfo: memFree=25114216/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 21 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50044 s]
/proc/loadavg: 5.74 8.75 9.65 2/176 3325
/proc/meminfo: memFree=25114216/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 18 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10715 s]
/proc/loadavg: 6.08 8.77 9.65 12/192 3341
/proc/meminfo: memFree=24998680/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1180364 CPUtime=3.09 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 12482 0 0 0 308 1 0 0 25 0 1 0 515293725 1208692736 7761 33554432000 4194304 4587354 140736273300240 18446744073709551615 4365294 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 295091 7761 337 96 0 291653 0
[pid=3327] ppid=3325 vsize=22888 CPUtime=3.09 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 3263 0 0 0 309 0 0 0 25 0 1 0 515293725 23437312 3070 33554432000 4194304 4785740 140736162146368 18446744073709551615 4550460 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 5722 3070 340 145 0 2767 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=1.98 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 198 0 0 0 21 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=6488 CPUtime=3.1 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 1211 0 0 0 310 0 0 0 25 0 1 0 515293725 6643712 784 33554432000 4194304 4352236 140734202616848 18446744073709551615 4328114 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 1622 784 127 39 0 702 0
[pid=3330] ppid=3325 vsize=12732 CPUtime=1.09 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 3819 0 0 0 109 0 0 0 25 0 1 0 515293725 13037568 1283 33554432000 4194304 4331988 140736281347296 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 3183 1283 174 34 0 1625 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 1699688

[startup+6.30057 s]
/proc/loadavg: 6.39 8.79 9.66 11/192 3341
/proc/meminfo: memFree=24980448/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1178936 CPUtime=6.29 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 14526 0 0 0 627 2 0 0 25 0 1 0 515293725 1207230464 8238 33554432000 4194304 4587354 140736273300240 18446744073709551615 4238512 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 294734 8238 337 96 0 291296 0
[pid=3327] ppid=3325 vsize=26516 CPUtime=6.29 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 4150 0 0 0 629 0 0 0 25 0 1 0 515293725 27152384 3957 33554432000 4194304 4785740 140736162146368 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 6629 3957 340 145 0 3674 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=3.56 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 356 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134530619 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=8288 CPUtime=6.29 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 1693 0 0 0 629 0 0 0 25 0 1 0 515293725 8486912 1266 33554432000 4194304 4352236 140734202616848 18446744073709551615 4267912 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 2072 1266 127 39 0 1152 0
[pid=3330] ppid=3325 vsize=13168 CPUtime=2.69 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 3833 0 0 0 269 0 0 0 25 0 1 0 515293725 13484032 1297 33554432000 4194304 4331988 140736281347296 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 3292 1297 174 34 0 1734 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 1704124

[startup+12.7004 s]
/proc/loadavg: 6.68 8.81 9.66 12/192 3342
/proc/meminfo: memFree=24950224/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1198176 CPUtime=12.69 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 22653 0 0 0 1266 3 0 0 25 0 1 0 515293725 1226932224 12600 33554432000 4194304 4587354 140736273300240 18446744073709551615 4388345 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 299544 12600 337 96 0 296106 0
[pid=3327] ppid=3325 vsize=29892 CPUtime=12.68 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 4986 0 0 0 1268 0 0 0 25 0 1 0 515293725 30609408 4793 33554432000 4194304 4785740 140736162146368 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 7473 4793 340 145 0 4518 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=6.73 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 673 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=8548 CPUtime=12.68 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 2014 0 0 0 1268 0 0 0 25 0 1 0 515293725 8753152 1331 33554432000 4194304 4352236 140734202616848 18446744073709551615 4276514 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 2137 1331 127 39 0 1217 0
[pid=3330] ppid=3325 vsize=14704 CPUtime=5.89 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 4156 0 0 0 589 0 0 0 25 0 1 0 515293725 15056896 1620 33554432000 4194304 4331988 140736281347296 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 3676 1620 175 34 0 2118 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 1728536

[startup+25.5011 s]
/proc/loadavg: 7.26 8.86 9.67 11/192 3342
/proc/meminfo: memFree=24966200/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1213048 CPUtime=25.49 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 43790 0 0 0 2543 6 0 0 25 0 1 0 515293725 1242161152 17141 33554432000 4194304 4587354 140736273300240 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 303262 17141 337 96 0 299824 0
[pid=3327] ppid=3325 vsize=35204 CPUtime=25.48 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 6290 0 0 0 2548 0 0 0 25 0 1 0 515293725 36048896 6097 33554432000 4194304 4785740 140736162146368 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 8801 6097 340 145 0 5846 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=13.1 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 1310 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=8168 CPUtime=25.49 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 2239 0 0 0 2549 0 0 0 25 0 1 0 515293725 8364032 1236 33554432000 4194304 4352236 140734202616848 18446744073709551615 4276475 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 2042 1236 127 39 0 1122 0
[pid=3330] ppid=3325 vsize=15468 CPUtime=12.24 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 4445 0 0 0 1224 0 0 0 25 0 1 0 515293725 15839232 1909 33554432000 4194304 4331988 140736281347296 18446744073709551615 4239684 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 3867 1909 175 34 0 2309 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 1749104

[startup+51.1004 s]
/proc/loadavg: 8.42 8.99 9.68 11/192 3343
/proc/meminfo: memFree=24919980/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1165172 CPUtime=51.09 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 54921 0 0 0 5099 10 0 0 25 0 1 0 515293725 1193136128 5045 33554432000 4194304 4587354 140736273300240 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 291293 5045 337 96 0 287855 0
[pid=3327] ppid=3325 vsize=41968 CPUtime=51.08 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 7928 0 0 0 5107 1 0 0 25 0 1 0 515293725 42975232 7735 33554432000 4194304 4785740 140736162146368 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 10492 7735 340 145 0 7537 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=25.82 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 2582 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134530648 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=9068 CPUtime=51.08 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 2995 0 0 0 5108 0 0 0 25 0 1 0 515293725 9285632 1448 33554432000 4194304 4352236 140734202616848 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 2267 1448 127 39 0 1347 0
[pid=3330] ppid=3325 vsize=18344 CPUtime=24.99 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 5015 0 0 0 2498 1 0 0 25 0 1 0 515293725 18784256 2479 33554432000 4194304 4331988 140736281347296 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 4586 2479 175 34 0 3028 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 1711768

[startup+102.301 s]
/proc/loadavg: 9.47 9.19 9.71 11/192 3344
/proc/meminfo: memFree=24791728/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1233936 CPUtime=102.29 cores=0

################
# More data... #
################

/proc/3330/statm: 25784 21036 175 34 0 24226 0
Current children cumulated CPU time (s) 3524.33
Current children cumulated vsize (KiB) 1909356

[startup+942.3 s]
/proc/loadavg: 10.25 10.26 10.06 11/192 3403
/proc/meminfo: memFree=24345600/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1190872 CPUtime=942.28 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 527408 0 0 0 94064 164 0 0 25 0 1 0 515293725 1219452928 18753 33554432000 4194304 4587354 140736273300240 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 297718 18753 337 96 0 294280 0
[pid=3327] ppid=3325 vsize=108840 CPUtime=942.22 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 23606 0 0 0 94216 6 0 0 25 0 1 0 515293725 111452160 23366 33554432000 4194304 4785740 140736162146368 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 27210 23366 341 145 0 24255 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=469.03 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 46903 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134530332 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=16496 CPUtime=942.31 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 25751 0 0 0 94227 4 0 0 25 0 1 0 515293725 16891904 3318 33554432000 4194304 4352236 140734202616848 18446744073709551615 4328308 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 4124 3318 127 39 0 3204 0
[pid=3330] ppid=3325 vsize=103136 CPUtime=468.14 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 24858 0 0 0 46807 7 0 0 25 0 1 0 515293725 105611264 22322 33554432000 4194304 4331988 140736281347296 18446744073709551615 4228331 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 25784 22322 175 34 0 24226 0
Current children cumulated CPU time (s) 3763.98
Current children cumulated vsize (KiB) 1896560

[startup+1002.3 s]
/proc/loadavg: 10.30 10.27 10.08 12/192 3405
/proc/meminfo: memFree=24302288/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1193356 CPUtime=1002.29 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 546262 0 0 0 100056 173 0 0 25 0 1 0 515293725 1221996544 19891 33554432000 4194304 4587354 140736273300240 18446744073709551615 4228754 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 298339 19891 337 96 0 294901 0
[pid=3327] ppid=3325 vsize=110904 CPUtime=1002.22 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 24101 0 0 0 100216 6 0 0 25 0 1 0 515293725 113565696 23861 33554432000 4194304 4785740 140736162146368 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 27726 23861 341 145 0 24771 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=498.83 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 49883 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134528710 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=16372 CPUtime=1002.31 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 26936 0 0 0 100227 4 0 0 25 0 1 0 515293725 16764928 3287 33554432000 4194304 4352236 140734202616848 18446744073709551615 4328191 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 4093 3287 127 39 0 3173 0
[pid=3330] ppid=3325 vsize=103136 CPUtime=498.02 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 26128 0 0 0 49794 8 0 0 25 0 1 0 515293725 105611264 23592 33554432000 4194304 4331988 140736281347296 18446744073709551615 4210390 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 25784 23592 175 34 0 24226 0
Current children cumulated CPU time (s) 4003.67
Current children cumulated vsize (KiB) 1900984

[startup+1062.3 s]
/proc/loadavg: 10.39 10.29 10.10 12/192 3407
/proc/meminfo: memFree=24265052/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1217228 CPUtime=1062.29 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 566357 0 0 0 106048 181 0 0 25 0 1 0 515293725 1246441472 14507 33554432000 4194304 4587354 140736273300240 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 304307 14507 337 96 0 300869 0
[pid=3327] ppid=3325 vsize=113768 CPUtime=1062.22 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 24710 0 0 0 106216 6 0 0 25 0 1 0 515293725 116498432 24470 33554432000 4194304 4785740 140736162146368 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 28442 24470 341 145 0 25487 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=528.71 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 52871 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=16500 CPUtime=1062.32 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 28216 0 0 0 106228 4 0 0 25 0 1 0 515293725 16896000 3319 33554432000 4194304 4352236 140734202616848 18446744073709551615 4208067 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 4125 3319 127 39 0 3205 0
[pid=3330] ppid=3325 vsize=147336 CPUtime=527.82 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 27388 0 0 0 52773 9 0 0 25 0 1 0 515293725 150872064 24852 33554432000 4194304 4331988 140736281347296 18446744073709551615 4265490 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 36834 24852 175 34 0 35276 0
Current children cumulated CPU time (s) 4243.36
Current children cumulated vsize (KiB) 1972048

[startup+1122.3 s]
/proc/loadavg: 10.20 10.25 10.09 11/192 3408
/proc/meminfo: memFree=24270596/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1189712 CPUtime=1122.29 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 583315 0 0 0 112040 189 0 0 25 0 1 0 515293725 1218265088 20009 33554432000 4194304 4587354 140736273300240 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 297428 20009 337 96 0 293990 0
[pid=3327] ppid=3325 vsize=113956 CPUtime=1122.21 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 24761 0 0 0 112215 6 0 0 25 0 1 0 515293725 116690944 24521 33554432000 4194304 4785740 140736162146368 18446744073709551615 4551048 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 28489 24521 341 145 0 25534 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=558.52 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 55852 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134530260 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=21492 CPUtime=1122.31 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 29464 0 0 0 112227 4 0 0 25 0 1 0 515293725 22007808 4567 33554432000 4194304 4352236 140734202616848 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 5373 4567 127 39 0 4453 0
[pid=3330] ppid=3325 vsize=148648 CPUtime=557.68 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 28636 0 0 0 55759 9 0 0 25 0 1 0 515293725 152215552 26100 33554432000 4194304 4331988 140736281347296 18446744073709551615 4265367 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 37162 26100 175 34 0 35604 0
Current children cumulated CPU time (s) 4483.01
Current children cumulated vsize (KiB) 1951024

[startup+1182.31 s]
/proc/loadavg: 10.27 10.26 10.10 11/192 3411
/proc/meminfo: memFree=24264600/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1190872 CPUtime=1182.29 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 601488 0 0 0 118031 198 0 0 25 0 1 0 515293725 1219452928 18925 33554432000 4194304 4587354 140736273300240 18446744073709551615 4238477 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 297718 18925 337 96 0 294280 0
[pid=3327] ppid=3325 vsize=115452 CPUtime=1182.21 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 25100 0 0 0 118215 6 0 0 25 0 1 0 515293725 118222848 24860 33554432000 4194304 4785740 140736162146368 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 28863 24860 341 145 0 25908 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=588.37 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 58837 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=17140 CPUtime=1182.32 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 29656 0 0 0 118228 4 0 0 25 0 1 0 515293725 17551360 3479 33554432000 4194304 4352236 140734202616848 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 4285 3479 127 39 0 3365 0
[pid=3330] ppid=3325 vsize=148648 CPUtime=587.5 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 29867 0 0 0 58741 9 0 0 25 0 1 0 515293725 152215552 27331 33554432000 4194304 4331988 140736281347296 18446744073709551615 4265504 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 37162 27331 175 34 0 35604 0
Current children cumulated CPU time (s) 4722.69
Current children cumulated vsize (KiB) 1949328



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.26 10.26 10.10 11/192 3411
/proc/meminfo: memFree=24233336/32951124 swapFree=67111352/67111528
[pid=3325] ppid=3323 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3325/stat : 3325 (ppfolio) S 3323 3325 2100 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515293724 18763776 390 33554432000 4194304 4287625 140736679416480 18446744073709551615 246516854287 0 0 4096 65536 3238905760708558847 0 0 17 4 0 0 0
/proc/3325/statm: 4581 390 341 23 0 91 0
[pid=3326] ppid=3325 vsize=1217472 CPUtime=1201.69 cores=0
/proc/3326/stat : 3326 (cryptominisat) R 3325 3325 2100 0 -1 4202496 609457 0 0 0 119967 202 0 0 25 0 1 0 515293725 1246691328 19059 33554432000 4194304 4587354 140736273300240 18446744073709551615 4236606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3326/statm: 304368 19059 337 96 0 300930 0
[pid=3327] ppid=3325 vsize=115724 CPUtime=1201.61 cores=4
/proc/3327/stat : 3327 (clasp) R 3325 3325 2100 0 -1 4202496 25136 0 0 0 120155 6 0 0 25 0 1 0 515293725 118501376 24896 33554432000 4194304 4785740 140736162146368 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3327/statm: 28931 24896 341 145 0 25976 0
[pid=3328] ppid=3325 vsize=458892 CPUtime=598.01 cores=6
/proc/3328/stat : 3328 (TNM) R 3325 3325 2100 0 -1 4202496 1275 0 0 0 59801 0 0 0 25 0 1 0 515293725 469905408 1172 33554432000 134512640 134534564 4292997984 18446744073709551615 134528710 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3328/statm: 114723 1172 95 6 0 113389 0
[pid=3329] ppid=3325 vsize=21492 CPUtime=1201.72 cores=2
/proc/3329/stat : 3329 (lingeling) R 3325 3325 2100 0 -1 4202496 30744 0 0 0 120168 4 0 0 25 0 1 0 515293725 22007808 4567 33554432000 4194304 4352236 140734202616848 18446744073709551615 4328102 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3329/statm: 5373 4567 127 39 0 4453 0
[pid=3330] ppid=3325 vsize=148648 CPUtime=597.16 cores=6
/proc/3330/stat : 3330 (march_hi) R 3325 3325 2100 0 -1 4202496 30262 0 0 0 59706 10 0 0 25 0 1 0 515293725 152215552 27726 33554432000 4194304 4331988 140736281347296 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3330/statm: 37162 27726 175 34 0 35604 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 1980552

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3325 and gives
#  childrusage.ru_utime.tv_sec=2401
#  childrusage.ru_utime.tv_usec=368936
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=84683
# CPU time returned by wait4() is 2403.45
# while last known CPU time is 4800.19
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.19
CPU user time (s): 4797.97
CPU system time (s): 2.22
CPU usage (%): 399.445
Max. virtual memory (cumulated for all children) (KiB): 3073144

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2401.37
system time used= 2.08468
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 640728
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 335
involuntary context switches= 6338

runsolver used 1.85372 second user time and 4.70528 second system time

The end

Launcher Data 

Begin job on node134 at 2011-04-29 02:29:15
IDJOB=3190817
IDBENCH=82548
IDSOLVER=1612
FILE ID=node134/3190817-1304036955
RUNJOBID= node134-1304036955-3306
PBS_JOBID= 13170318
Free space on /tmp= 71584 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k5-r20-v1000-c20000-S72635791-098-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3190817-1304036955/watcher-3190817-1304036955 -o /tmp/evaluation-result-3190817-1304036955/solver-3190817-1304036955 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3190817-1304036955.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 93976db0d99d3daab756f06103f77642
RANDOM SEED=593370330

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25114372 kB
Buffers:       1470000 kB
Cached:        5780640 kB
SwapCached:         64 kB
Active:        1388824 kB
Inactive:      5925568 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25114372 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:           21380 kB
Writeback:          12 kB
AnonPages:       62904 kB
Mapped:          14548 kB
Slab:           458636 kB
PageTables:       4284 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186780 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71564 MiB
End job on node134 at 2011-04-29 02:49:19