Trace number 3265209

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.18 1201.71

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
harder/php-040-039.shuffled-as.sat05-1194.cnf
MD5SUM8c84d9b9f2d75de33656119bc03a9afb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark45.3841
Satisfiable
(Un)Satisfiability was proved
Number of variables1560
Number of clauses30460
Sum of the clauses size62400
Maximum clause length39
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 230420
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265209-1304095459/watcher-3265209-1304095459 -o /tmp/evaluation-result-3265209-1304095459/solver-3265209-1304095459 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3265209-1304095459.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.20 9.81 9.37 6/182 24682
/proc/meminfo: memFree=19303716/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) R 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0

[startup+0.469183 s]
/proc/loadavg: 10.20 9.81 9.37 6/182 24682
/proc/meminfo: memFree=19303716/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.569165 s]
/proc/loadavg: 10.20 9.81 9.37 6/182 24682
/proc/meminfo: memFree=19303716/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.600158 s]
/proc/loadavg: 10.20 9.81 9.37 6/182 24682
/proc/meminfo: memFree=19303716/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700143 s]
/proc/loadavg: 10.20 9.81 9.37 6/182 24682
/proc/meminfo: memFree=19303716/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.507 s]
/proc/loadavg: 10.20 9.81 9.37 11/188 24688
/proc/meminfo: memFree=19267460/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2093872 CPUtime=1.49 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 4447 0 0 0 149 0 0 0 23 0 1 0 521143915 2144124928 3076 33554432000 4194304 4587354 140736082387344 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 523468 3076 327 96 0 520030 0
[pid=24684] ppid=24682 vsize=28672 CPUtime=1.48 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 4788 0 0 0 148 0 0 0 25 0 1 0 521143915 29360128 4516 33554432000 4194304 4785740 140734369934272 18446744073709551615 228122410763 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 7168 4516 340 145 0 4213 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=0.78 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 78 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134528464 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=6084 CPUtime=1.5 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 945 0 0 0 150 0 0 0 25 0 1 0 521143915 6230016 713 33554432000 4194304 4352236 140737103749232 18446744073709551615 4278762 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 1521 713 126 39 0 601 0
[pid=24687] ppid=24682 vsize=13012 CPUtime=0.71 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 1418 0 0 0 71 0 0 0 25 0 1 0 521143915 13324288 1059 33554432000 4194304 4331988 140734225656816 18446744073709551615 228122109122 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 3253 1059 174 34 0 1695 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 2617636

[startup+3.10071 s]
/proc/loadavg: 10.20 9.81 9.37 11/188 24688
/proc/meminfo: memFree=19259392/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2103804 CPUtime=3.09 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 6512 0 0 0 308 1 0 0 25 0 1 0 521143915 2154295296 3606 33554432000 4194304 4587354 140736082387344 18446744073709551615 4238576 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 525951 3606 327 96 0 522513 0
[pid=24684] ppid=24682 vsize=34644 CPUtime=3.07 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 6279 0 0 0 307 0 0 0 25 0 1 0 521143915 35475456 6007 33554432000 4194304 4785740 140734369934272 18446744073709551615 4309510 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 8661 6007 340 145 0 5706 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=1.56 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 156 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134528453 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=8616 CPUtime=3.09 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 1483 0 0 0 309 0 0 0 25 0 1 0 521143915 8822784 1251 33554432000 4194304 4352236 140737103749232 18446744073709551615 4207627 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 2154 1251 126 39 0 1234 0
[pid=24687] ppid=24682 vsize=13192 CPUtime=1.51 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 1479 0 0 0 151 0 0 0 25 0 1 0 521143915 13508608 1119 33554432000 4194304 4331988 140734225656816 18446744073709551615 4228287 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 3298 1119 174 34 0 1740 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 2636252

[startup+6.30114 s]
/proc/loadavg: 10.18 9.81 9.38 12/188 24689
/proc/meminfo: memFree=19208436/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=71312 CPUtime=6.29 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 19132 0 0 0 626 3 0 0 25 0 1 0 521143915 73023488 12226 33554432000 4194304 4587354 140736082387344 18446744073709551615 4365352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 17828 12226 337 96 0 14390 0
[pid=24684] ppid=24682 vsize=43308 CPUtime=6.27 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 8388 0 0 0 627 0 0 0 25 0 1 0 521143915 44347392 8116 33554432000 4194304 4785740 140734369934272 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 10827 8116 340 145 0 7872 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=3.15 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 315 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134528710 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=10664 CPUtime=6.29 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 1995 0 0 0 629 0 0 0 25 0 1 0 521143915 10919936 1763 33554432000 4194304 4352236 140737103749232 18446744073709551615 4278496 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 2666 1763 126 39 0 1746 0
[pid=24687] ppid=24682 vsize=13444 CPUtime=3.11 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 1538 0 0 0 311 0 0 0 25 0 1 0 521143915 13766656 1178 33554432000 4194304 4331988 140734225656816 18446744073709551615 4313561 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 3361 1178 175 34 0 1803 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 614724

[startup+12.701 s]
/proc/loadavg: 10.17 9.81 9.38 11/188 24689
/proc/meminfo: memFree=19175368/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2150504 CPUtime=12.69 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 24459 0 0 0 1265 4 0 0 25 0 1 0 521143915 2202116096 14960 33554432000 4194304 4587354 140736082387344 18446744073709551615 4364888 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 537626 14960 337 96 0 534188 0
[pid=24684] ppid=24682 vsize=59828 CPUtime=12.67 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 12516 0 0 0 1266 1 0 0 25 0 1 0 521143915 61263872 12244 33554432000 4194304 4785740 140734369934272 18446744073709551615 4304061 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 14957 12244 340 145 0 12002 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=6.34 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 634 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=14760 CPUtime=12.69 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 3114 0 0 0 1269 0 0 0 25 0 1 0 521143915 15114240 2882 33554432000 4194304 4352236 140737103749232 18446744073709551615 4281245 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 3690 2882 126 39 0 2770 0
[pid=24687] ppid=24682 vsize=14012 CPUtime=6.27 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 1652 0 0 0 627 0 0 0 25 0 1 0 521143915 14348288 1292 33554432000 4194304 4331988 140734225656816 18446744073709551615 228122109100 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 3503 1292 175 34 0 1945 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 2715100

[startup+25.5007 s]
/proc/loadavg: 10.29 9.86 9.40 11/188 24689
/proc/meminfo: memFree=19131804/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2165648 CPUtime=25.49 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 33413 0 0 0 2544 5 0 0 25 0 1 0 521143915 2217623552 20991 33554432000 4194304 4587354 140736082387344 18446744073709551615 4357668 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 541412 20991 337 96 0 537974 0
[pid=24684] ppid=24682 vsize=70404 CPUtime=25.47 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 15038 0 0 0 2545 2 0 0 25 0 1 0 521143915 72093696 14766 33554432000 4194304 4785740 140734369934272 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 17601 14766 340 145 0 14646 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=12.74 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 1274 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=16680 CPUtime=25.49 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 3499 0 0 0 2549 0 0 0 25 0 1 0 521143915 17080320 3267 33554432000 4194304 4352236 140737103749232 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 4170 3267 126 39 0 3250 0
[pid=24687] ppid=24682 vsize=15288 CPUtime=12.61 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 1875 0 0 0 1261 0 0 0 25 0 1 0 521143915 15654912 1515 33554432000 4194304 4331988 140734225656816 18446744073709551615 4226184 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 3822 1515 175 34 0 2264 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 2744016

[startup+51.1011 s]
/proc/loadavg: 10.31 9.90 9.42 11/188 24690
/proc/meminfo: memFree=19080232/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2292504 CPUtime=51.09 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 51167 0 0 0 5101 8 0 0 25 0 1 0 521143915 2347524096 28519 33554432000 4194304 4587354 140736082387344 18446744073709551615 4236883 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 573126 28519 337 96 0 569688 0
[pid=24684] ppid=24682 vsize=87688 CPUtime=51.06 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 19316 0 0 0 5104 2 0 0 25 0 1 0 521143915 89792512 19044 33554432000 4194304 4785740 140734369934272 18446744073709551615 4416798 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 21922 19044 340 145 0 18967 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=25.44 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 2544 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134529651 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=17256 CPUtime=51.08 cores=2

################
# More data... #
################

/proc/24687/statm: 25384 19309 175 34 0 23826 0
Current children cumulated CPU time (s) 3763.99
Current children cumulated vsize (KiB) 3326660

[startup+1002.3 s]
/proc/loadavg: 10.20 10.16 9.88 11/188 24747
/proc/meminfo: memFree=17782012/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2738804 CPUtime=1002.3 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 669949 0 0 0 100101 129 0 0 25 0 1 0 521143915 2804535296 165595 33554432000 4194304 4587354 140736082387344 18446744073709551615 4388345 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 684701 165595 337 96 0 681263 0
[pid=24684] ppid=24682 vsize=246168 CPUtime=1002.19 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 56701 0 0 0 100210 9 0 0 25 0 1 0 521143915 252076032 56429 33554432000 4194304 4785740 140734369934272 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 61542 56429 340 145 0 58587 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=498.47 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 49847 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=75160 CPUtime=1002.31 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 78138 0 0 0 100220 11 0 0 25 0 1 0 521143915 76963840 17888 33554432000 4194304 4352236 140737103749232 18446744073709551615 4231027 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 18790 17888 127 39 0 17870 0
[pid=24687] ppid=24682 vsize=101536 CPUtime=498.38 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 20748 0 0 0 49829 9 0 0 25 0 1 0 521143915 103972864 20387 33554432000 4194304 4331988 140734225656816 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 25384 20387 175 34 0 23826 0
Current children cumulated CPU time (s) 4003.65
Current children cumulated vsize (KiB) 3637664

[startup+1062.3 s]
/proc/loadavg: 10.12 10.14 9.89 11/188 24758
/proc/meminfo: memFree=17699384/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2738804 CPUtime=1062.31 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 669949 0 0 0 106102 129 0 0 25 0 1 0 521143915 2804535296 165595 33554432000 4194304 4587354 140736082387344 18446744073709551615 4357662 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 684701 165595 337 96 0 681263 0
[pid=24684] ppid=24682 vsize=253528 CPUtime=1062.19 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 58466 0 0 0 106209 10 0 0 25 0 1 0 521143915 259612672 58194 33554432000 4194304 4785740 140734369934272 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 63382 58194 340 145 0 60427 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=528.3 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 52830 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=58776 CPUtime=1062.31 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 82234 0 0 0 106219 12 0 0 25 0 1 0 521143915 60186624 13792 33554432000 4194304 4352236 140737103749232 18446744073709551615 4328395 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 14694 13792 127 39 0 13774 0
[pid=24687] ppid=24682 vsize=101536 CPUtime=528.22 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 21868 0 0 0 52812 10 0 0 25 0 1 0 521143915 103972864 21507 33554432000 4194304 4331988 140734225656816 18446744073709551615 4237192 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 25384 21507 175 34 0 23826 0
Current children cumulated CPU time (s) 4243.33
Current children cumulated vsize (KiB) 3628640

[startup+1122.3 s]
/proc/loadavg: 10.18 10.16 9.91 11/188 24759
/proc/meminfo: memFree=17676552/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2738804 CPUtime=1122.31 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 669949 0 0 0 112102 129 0 0 25 0 1 0 521143915 2804535296 165595 33554432000 4194304 4587354 140736082387344 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 684701 165595 337 96 0 681263 0
[pid=24684] ppid=24682 vsize=255648 CPUtime=1122.19 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 58992 0 0 0 112209 10 0 0 25 0 1 0 521143915 261783552 58720 33554432000 4194304 4785740 140734369934272 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 63912 58720 340 145 0 60957 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=558.16 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 55816 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134530573 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=75160 CPUtime=1122.32 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 86330 0 0 0 112219 13 0 0 25 0 1 0 521143915 76963840 17888 33554432000 4194304 4352236 140737103749232 18446744073709551615 4278667 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 18790 17888 127 39 0 17870 0
[pid=24687] ppid=24682 vsize=101536 CPUtime=558.04 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 22984 0 0 0 55794 10 0 0 25 0 1 0 521143915 103972864 22623 33554432000 4194304 4331988 140734225656816 18446744073709551615 4210426 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 25384 22623 175 34 0 23826 0
Current children cumulated CPU time (s) 4483.02
Current children cumulated vsize (KiB) 3647144

[startup+1182.3 s]
/proc/loadavg: 10.18 10.16 9.92 11/188 24761
/proc/meminfo: memFree=17749700/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2750084 CPUtime=1182.31 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 672451 0 0 0 118102 129 0 0 25 0 1 0 521143915 2816086016 168097 33554432000 4194304 4587354 140736082387344 18446744073709551615 4364908 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 687521 168097 337 96 0 684083 0
[pid=24684] ppid=24682 vsize=259068 CPUtime=1182.18 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 59805 0 0 0 118208 10 0 0 25 0 1 0 521143915 265285632 59533 33554432000 4194304 4785740 140734369934272 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 64767 59533 340 145 0 61812 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=587.96 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 58796 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=58776 CPUtime=1182.32 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 86393 0 0 0 118219 13 0 0 25 0 1 0 521143915 60186624 13855 33554432000 4194304 4352236 140737103749232 18446744073709551615 4331418 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 14694 13855 127 39 0 13774 0
[pid=24687] ppid=24682 vsize=145736 CPUtime=587.91 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 24082 0 0 0 58780 11 0 0 25 0 1 0 521143915 149233664 23721 33554432000 4194304 4331988 140734225656816 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 36434 23721 175 34 0 34876 0
Current children cumulated CPU time (s) 4722.68
Current children cumulated vsize (KiB) 3689660



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.21 10.16 9.93 12/189 24764
/proc/meminfo: memFree=17581296/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2750084 CPUtime=1201.71 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 672451 0 0 0 120042 129 0 0 25 0 1 0 521143915 2816086016 168097 33554432000 4194304 4587354 140736082387344 18446744073709551615 4365216 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 687521 168097 337 96 0 684083 0
[pid=24684] ppid=24682 vsize=259068 CPUtime=1201.59 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 59842 0 0 0 120149 10 0 0 25 0 1 0 521143915 265285632 59570 33554432000 4194304 4785740 140734369934272 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 64767 59570 340 145 0 61812 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=597.65 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 59765 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=75160 CPUtime=1201.72 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 90489 0 0 0 120159 13 0 0 25 0 1 0 521143915 76963840 17951 33554432000 4194304 4352236 140737103749232 18446744073709551615 4278223 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 18790 17951 127 39 0 17870 0
[pid=24687] ppid=24682 vsize=145736 CPUtime=597.51 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 24473 0 0 0 59740 11 0 0 25 0 1 0 521143915 149233664 24112 33554432000 4194304 4331988 140734225656816 18446744073709551615 4226443 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 36434 24112 175 34 0 34876 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 3706044

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 10.21 10.16 9.93 12/189 24764
/proc/meminfo: memFree=17581296/32951124 swapFree=67111524/67111528
[pid=24682] ppid=24680 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/24682/stat : 24682 (ppfolio) S 24680 24682 23533 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 521143915 18763776 389 33554432000 4194304 4287625 140736696585056 18446744073709551615 228122734095 0 0 4096 65536 4367559806739808255 0 0 17 4 0 0 0
/proc/24682/statm: 4581 389 341 23 0 91 0
[pid=24683] ppid=24682 vsize=2750084 CPUtime=1201.71 cores=0
/proc/24683/stat : 24683 (cryptominisat) R 24682 24682 23533 0 -1 4202496 672451 0 0 0 120042 129 0 0 25 0 1 0 521143915 2816086016 168097 33554432000 4194304 4587354 140736082387344 18446744073709551615 4365216 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24683/statm: 687521 168097 337 96 0 684083 0
[pid=24684] ppid=24682 vsize=259068 CPUtime=1201.59 cores=4
/proc/24684/stat : 24684 (clasp) R 24682 24682 23533 0 -1 4202496 59842 0 0 0 120149 10 0 0 25 0 1 0 521143915 265285632 59570 33554432000 4194304 4785740 140734369934272 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/24684/statm: 64767 59570 340 145 0 61812 0
[pid=24685] ppid=24682 vsize=457672 CPUtime=597.65 cores=6
/proc/24685/stat : 24685 (TNM) R 24682 24682 23533 0 -1 4202496 1060 0 0 0 59765 0 0 0 25 0 1 0 521143915 468656128 957 33554432000 134512640 134534564 4292870512 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24685/statm: 114418 957 95 6 0 113084 0
[pid=24686] ppid=24682 vsize=75160 CPUtime=1201.72 cores=2
/proc/24686/stat : 24686 (lingeling) R 24682 24682 23533 0 -1 4202496 90489 0 0 0 120159 13 0 0 25 0 1 0 521143915 76963840 17951 33554432000 4194304 4352236 140737103749232 18446744073709551615 4278223 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/24686/statm: 18790 17951 127 39 0 17870 0
[pid=24687] ppid=24682 vsize=145736 CPUtime=597.51 cores=6
/proc/24687/stat : 24687 (march_hi) R 24682 24682 23533 0 -1 4202496 24473 0 0 0 59740 11 0 0 25 0 1 0 521143915 149233664 24112 33554432000 4194304 4331988 140734225656816 18446744073709551615 4226443 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/24687/statm: 36434 24112 175 34 0 34876 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 3706044

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24682 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=5999
# CPU time returned by wait4() is 0.006998
# while last known CPU time is 4800.18
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.18
CPU user time (s): 4798.55
CPU system time (s): 1.63
CPU usage (%): 399.444
Max. virtual memory (cumulated for all children) (KiB): 5389496

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.005999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 520
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 335
involuntary context switches= 6

runsolver used 1.9557 second user time and 4.6083 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-29 18:44:19
IDJOB=3265209
IDBENCH=85456
IDSOLVER=1612
FILE ID=node138/3265209-1304095459
RUNJOBID= node138-1304093161-24369
PBS_JOBID= 13170556
Free space on /tmp= 71804 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/harder/php-040-039.shuffled-as.sat05-1194.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265209-1304095459/watcher-3265209-1304095459 -o /tmp/evaluation-result-3265209-1304095459/solver-3265209-1304095459 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3265209-1304095459.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8c84d9b9f2d75de33656119bc03a9afb
RANDOM SEED=1037381305

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19303996 kB
Buffers:       2035712 kB
Cached:       10838760 kB
SwapCached:          4 kB
Active:        3009544 kB
Inactive:     10070356 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19303996 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           10112 kB
Writeback:           0 kB
AnonPages:      205564 kB
Mapped:          16892 kB
Slab:           499916 kB
PageTables:       5856 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1685928 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71796 MiB
End job on node138 at 2011-04-29 19:04:23