Trace number 3289813

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1299.99 1300.01

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom23.cnf
MD5SUMe560aa6505ddce6d3784f70d5b7aff66
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables57800
Number of clauses193923
Sum of the clauses size495331
Maximum clause length1803
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 298497
Number of clauses of size 394437
Number of clauses of size 4275
Number of clauses of size 521
Number of clauses of size over 5692

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 5
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 5

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289813-1303775623/watcher-3289813-1303775623 -o /tmp/evaluation-result-3289813-1303775623/solver-3289813-1303775623 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3289813-1303775623.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.85 1.70 2.79 5/188 25138
/proc/meminfo: memFree=18399752/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0 cores=5,7
/proc/25138/stat : 25138 (ppfolio) R 25136 25138 22378 0 -1 4202496 483 0 0 0 0 0 0 0 21 0 1 0 489164968 18763776 391 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634335637 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/25138/statm: 4581 391 343 23 0 91 0

[startup+0.03903 s]
/proc/loadavg: 0.85 1.70 2.79 5/188 25138
/proc/meminfo: memFree=18399752/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 23 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 239299720713863168 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.101017 s]
/proc/loadavg: 0.85 1.70 2.79 5/188 25138
/proc/meminfo: memFree=18399752/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 23 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 544188599969513472 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.300986 s]
/proc/loadavg: 0.85 1.70 2.79 5/188 25138
/proc/meminfo: memFree=18399752/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 23 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 544188599969513472 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.700913 s]
/proc/loadavg: 0.85 1.70 2.79 5/188 25138
/proc/meminfo: memFree=18399752/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 23 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 544188599969513472 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+1.50077 s]
/proc/loadavg: 0.85 1.70 2.79 9/198 25156
/proc/meminfo: memFree=18285204/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 23 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 544188599969513472 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=43532 CPUtime=0.71 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 5915 0 0 0 71 0 0 0 25 0 1 0 489164969 44576768 5678 33554432000 4194304 4587354 140735027492656 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 10883 5678 306 96 0 7445 0
[pid=25140] ppid=25138 vsize=46188 CPUtime=0.74 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 11159 0 0 0 73 1 0 0 25 0 1 0 489164969 47296512 8689 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 11547 8689 340 145 0 8592 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 108044

[startup+3.10049 s]
/proc/loadavg: 1.42 1.81 2.81 9/198 25156
/proc/meminfo: memFree=18215764/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=72076 CPUtime=1.51 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 17226 0 0 0 150 1 0 0 25 0 1 0 489164969 73805824 13292 33554432000 4194304 4587354 140735027492656 18446744073709551615 216634174196 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 18019 13292 320 96 0 14581 0
[pid=25140] ppid=25138 vsize=46188 CPUtime=1.54 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 11161 0 0 0 153 1 0 0 25 0 1 0 489164969 47296512 8691 33554432000 4194304 4785740 140734344614816 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 11547 8691 340 145 0 8592 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 136588

[startup+6.30093 s]
/proc/loadavg: 1.42 1.81 2.81 9/198 25156
/proc/meminfo: memFree=18133800/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=114276 CPUtime=3.12 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 18663 0 0 0 310 2 0 0 25 0 1 0 489164969 117018624 14709 33554432000 4194304 4587354 140735027492656 18446744073709551615 4230383 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 28569 14709 330 96 0 25131 0
[pid=25140] ppid=25138 vsize=46852 CPUtime=3.14 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 11376 0 0 0 313 1 0 0 25 0 1 0 489164969 47976448 8906 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 11713 8906 340 145 0 8758 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 179452

[startup+12.7008 s]
/proc/loadavg: 2.43 2.01 2.87 9/198 25156
/proc/meminfo: memFree=18113372/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1120856 CPUtime=6.32 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 21422 0 0 0 630 2 0 0 25 0 1 0 489164969 1147756544 14373 33554432000 4194304 4587354 140735027492656 18446744073709551615 4241151 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 280214 14373 333 96 0 276776 0
[pid=25140] ppid=25138 vsize=52644 CPUtime=6.34 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 12814 0 0 0 633 1 0 0 25 0 1 0 489164969 53907456 10344 33554432000 4194304 4785740 140734344614816 18446744073709551615 4562683 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 13161 10344 340 145 0 10206 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 1191824

[startup+25.5005 s]
/proc/loadavg: 3.29 2.21 2.92 9/198 25156
/proc/meminfo: memFree=18022988/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1157356 CPUtime=12.72 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 27571 0 0 0 1269 3 0 0 25 0 1 0 489164969 1185132544 17126 33554432000 4194304 4587354 140735027492656 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 289339 17126 336 96 0 285901 0
[pid=25140] ppid=25138 vsize=64236 CPUtime=12.74 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 15661 0 0 0 1272 2 0 0 25 0 1 0 489164969 65777664 13191 33554432000 4194304 4785740 140734344614816 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 16059 13191 340 145 0 13104 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 1239916

[startup+51.101 s]
/proc/loadavg: 4.97 2.69 3.06 9/198 25157
/proc/meminfo: memFree=17963176/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1165240 CPUtime=25.52 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 33942 0 0 0 2548 4 0 0 25 0 1 0 489164969 1193205760 20730 33554432000 4194304 4587354 140735027492656 18446744073709551615 4237936 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 291310 20730 336 96 0 287872 0
[pid=25140] ppid=25138 vsize=75436 CPUtime=25.53 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 18397 0 0 0 2551 2 0 0 25 0 1 0 489164969 77246464 15927 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553280 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 18859 15927 340 145 0 15904 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 1259000

[startup+102.307 s]
/proc/loadavg: 6.79 3.58 3.34 9/198 25158
/proc/meminfo: memFree=17872848/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1230016 CPUtime=51.13 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 36039 0 0 0 5109 4 0 0 25 0 1 0 489164969 1259536384 22821 33554432000 4194304 4587354 140735027492656 18446744073709551615 4239225 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 307504 22821 336 96 0 304066 0
[pid=25140] ppid=25138 vsize=91024 CPUtime=51.13 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 22253 0 0 0 5110 3 0 0 25 0 1 0 489164969 93208576 19783 33554432000 4194304 4785740 140734344614816 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 22756 19783 340 145 0 19801 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 1339364

[startup+162.3 s]
/proc/loadavg: 7.55 4.38 3.63 9/198 25160
/proc/meminfo: memFree=17820352/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1190528 CPUtime=81.13 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 40422 0 0 0 8108 5 0 0 25 0 1 0 489164969 1219100672 27185 33554432000 4194304 4587354 140735027492656 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 297632 27185 336 96 0 294194 0
[pid=25140] ppid=25138 vsize=97416 CPUtime=81.13 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 23683 0 0 0 8109 4 0 0 25 0 1 0 489164969 99753984 21213 33554432000 4194304 4785740 140734344614816 18446744073709551615 4552872 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 24354 21213 340 145 0 21399 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 1306268

[startup+222.301 s]
/proc/loadavg: 7.83 5.04 3.90 9/198 25161
/proc/meminfo: memFree=17815476/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 2332361971250233344 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1152440 CPUtime=111.13 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 48748 0 0 0 11106 7 0 0 25 0 1 0 489164969 1180098560 21398 33554432000 4194304 4587354 140735027492656 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 288110 21398 336 96 0 284672 0
[pid=25140] ppid=25138 vsize=101728 CPUtime=111.12 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 24731 0 0 0 11108 4 0 0 25 0 1 0 489164969 104169472 22261 33554432000 4194304 4785740 140734344614816 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 25432 22261 340 145 0 22477 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 1272492

[startup+282.3 s]

################
# More data... #
################

/proc/meminfo: memFree=17421392/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1204212 CPUtime=381.13 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 135616 0 0 0 38083 30 0 0 25 0 1 0 489164969 1233113088 29685 33554432000 4194304 4587354 140735027492656 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 301053 29685 336 96 0 297615 0
[pid=25140] ppid=25138 vsize=199328 CPUtime=381.14 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 48853 0 0 0 38101 13 0 0 25 0 1 0 489164969 204111872 46383 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553234 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 49832 46383 340 145 0 46877 0
Current children cumulated CPU time (s) 762.28
Current children cumulated vsize (KiB) 1421864

[startup+822.301 s]
/proc/loadavg: 8.00 7.61 5.85 9/198 25189
/proc/meminfo: memFree=17423464/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4211305482012327936 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=118032 CPUtime=411.13 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 147038 0 0 0 41080 33 0 0 25 0 1 0 489164969 120864768 25511 33554432000 4194304 4587354 140735027492656 18446744073709551615 4238355 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 29508 25511 336 96 0 26070 0
[pid=25140] ppid=25138 vsize=199732 CPUtime=411.14 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 48912 0 0 0 41101 13 0 0 25 0 1 0 489164969 204525568 46442 33554432000 4194304 4785740 140734344614816 18446744073709551615 4278573 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 49933 46442 340 145 0 46978 0
Current children cumulated CPU time (s) 822.28
Current children cumulated vsize (KiB) 336088

[startup+882.3 s]
/proc/loadavg: 8.06 7.69 5.98 9/198 25191
/proc/meminfo: memFree=17396520/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1209692 CPUtime=441.12 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 153828 0 0 0 44076 36 0 0 25 0 1 0 489164969 1238724608 25512 33554432000 4194304 4587354 140735027492656 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 302423 25512 336 96 0 298985 0
[pid=25140] ppid=25138 vsize=207292 CPUtime=441.14 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 50763 0 0 0 44101 13 0 0 25 0 1 0 489164969 212267008 48293 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 51823 48293 340 145 0 48868 0
Current children cumulated CPU time (s) 882.27
Current children cumulated vsize (KiB) 1435308

[startup+942.301 s]
/proc/loadavg: 8.02 7.75 6.11 9/198 25193
/proc/meminfo: memFree=17411348/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1154344 CPUtime=471.12 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 160940 0 0 0 47074 38 0 0 25 0 1 0 489164969 1182048256 20054 33554432000 4194304 4587354 140735027492656 18446744073709551615 4237639 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 288586 20054 336 96 0 285148 0
[pid=25140] ppid=25138 vsize=211424 CPUtime=471.15 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 51784 0 0 0 47102 13 0 0 25 0 1 0 489164969 216498176 49314 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553075 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 52856 49314 340 145 0 49901 0
Current children cumulated CPU time (s) 942.28
Current children cumulated vsize (KiB) 1384092

[startup+1002.3 s]
/proc/loadavg: 8.11 7.82 6.23 10/198 25194
/proc/meminfo: memFree=17517588/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1152608 CPUtime=501.11 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 169710 0 0 0 50070 41 0 0 25 0 1 0 489164969 1180270592 22588 33554432000 4194304 4587354 140735027492656 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 288152 22588 336 96 0 284714 0
[pid=25140] ppid=25138 vsize=211424 CPUtime=501.15 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 51823 0 0 0 50102 13 0 0 25 0 1 0 489164969 216498176 49353 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 52856 49353 340 145 0 49901 0
Current children cumulated CPU time (s) 1002.27
Current children cumulated vsize (KiB) 1382356

[startup+1062.3 s]
/proc/loadavg: 7.41 7.67 6.28 8/197 25196
/proc/meminfo: memFree=17546700/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1169904 CPUtime=531.11 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 180594 0 0 0 53066 45 0 0 25 0 1 0 489164969 1197981696 19684 33554432000 4194304 4587354 140735027492656 18446744073709551615 4241151 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 292476 19684 336 96 0 289038 0
[pid=25140] ppid=25138 vsize=212516 CPUtime=531.16 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 52026 0 0 0 53103 13 0 0 25 0 1 0 489164969 217616384 49556 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553369 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 53129 49556 340 145 0 50174 0
Current children cumulated CPU time (s) 1062.28
Current children cumulated vsize (KiB) 1400744

[startup+1122.3 s]
/proc/loadavg: 7.15 7.54 6.32 8/197 25197
/proc/meminfo: memFree=17489376/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1169768 CPUtime=561.11 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 189559 0 0 0 56063 48 0 0 25 0 1 0 489164969 1197842432 21662 33554432000 4194304 4587354 140735027492656 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 292442 21662 336 96 0 289004 0
[pid=25140] ppid=25138 vsize=212516 CPUtime=561.15 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 52027 0 0 0 56102 13 0 0 25 0 1 0 489164969 217616384 49557 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 53129 49557 340 145 0 50174 0
Current children cumulated CPU time (s) 1122.27
Current children cumulated vsize (KiB) 1400608

[startup+1182.3 s]
/proc/loadavg: 7.05 7.44 6.36 8/197 25199
/proc/meminfo: memFree=17457088/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1141300 CPUtime=591.11 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 198332 0 0 0 59060 51 0 0 25 0 1 0 489164969 1168691200 22762 33554432000 4194304 4587354 140735027492656 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 285325 22762 336 96 0 281887 0
[pid=25140] ppid=25138 vsize=212516 CPUtime=591.15 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 52033 0 0 0 59102 13 0 0 25 0 1 0 489164969 217616384 49563 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 53129 49563 340 145 0 50174 0
Current children cumulated CPU time (s) 1182.27
Current children cumulated vsize (KiB) 1372140

[startup+1242.3 s]
/proc/loadavg: 7.02 7.36 6.40 8/197 25201
/proc/meminfo: memFree=17472172/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 4294934792 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1165572 CPUtime=621.12 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 209044 0 0 0 62057 55 0 0 25 0 1 0 489164969 1193545728 20196 33554432000 4194304 4587354 140735027492656 18446744073709551615 4237686 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 291393 20196 336 96 0 287955 0
[pid=25140] ppid=25138 vsize=212516 CPUtime=621.14 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 52037 0 0 0 62101 13 0 0 25 0 1 0 489164969 217616384 49567 33554432000 4194304 4785740 140734344614816 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 53129 49567 340 145 0 50174 0
Current children cumulated CPU time (s) 1242.27
Current children cumulated vsize (KiB) 1396412



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 7.00 7.30 6.43 5/190 25204
/proc/meminfo: memFree=17858704/32951124 swapFree=67111528/67111528
[pid=25138] ppid=25136 vsize=18324 CPUtime=0.01 cores=5,7
/proc/25138/stat : 25138 (ppfolio) S 25136 25138 22378 0 -1 4202496 500 1194 0 0 0 0 0 1 15 0 1 0 489164968 18763776 394 33554432000 4194304 4287625 140735282859792 18446744073709551615 216634535439 0 0 4096 65536 2181084388337385472 0 0 17 7 0 0 0
/proc/25138/statm: 4581 394 346 23 0 91 0
[pid=25139] ppid=25138 vsize=1189344 CPUtime=650 cores=5
/proc/25139/stat : 25139 (cryptominisat) R 25138 25138 22378 0 -1 4202496 222258 0 0 0 64941 59 0 0 25 0 1 0 489164969 1217888256 25195 33554432000 4194304 4587354 140735027492656 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25139/statm: 297336 25195 336 96 0 293898 0
[pid=25140] ppid=25138 vsize=220832 CPUtime=649.98 cores=5
/proc/25140/stat : 25140 (clasp) R 25138 25138 22378 0 -1 4202496 54023 0 0 0 64984 14 0 0 25 0 1 0 489164969 226131968 51553 33554432000 4194304 4785740 140734344614816 18446744073709551615 4552646 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/25140/statm: 55208 51553 340 145 0 52253 0
Current children cumulated CPU time (s) 1299.99
Current children cumulated vsize (KiB) 1428500

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25138 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=5999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=18997
# CPU time returned by wait4() is 0.024996
# while last known CPU time is 1299.99
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1299.99
CPU user time (s): 1299.25
CPU system time (s): 0.74
CPU usage (%): 99.9983
Max. virtual memory (cumulated for all children) (KiB): 2544860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.005999
system time used= 0.018997
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1694
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 258
involuntary context switches= 4

runsolver used 2.13468 second user time and 4.96924 second system time

The end

Launcher Data 

Begin job on node103 at 2011-04-26 01:53:43
IDJOB=3289813
IDBENCH=83137
IDSOLVER=1613
FILE ID=node103/3289813-1303775623
RUNJOBID= node103-1303775621-25103
PBS_JOBID= 13157156
Free space on /tmp= 70948 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom23.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289813-1303775623/watcher-3289813-1303775623 -o /tmp/evaluation-result-3289813-1303775623/solver-3289813-1303775623 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3289813-1303775623.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= e560aa6505ddce6d3784f70d5b7aff66
RANDOM SEED=2097334244

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18400156 kB
Buffers:       2125152 kB
Cached:       11711256 kB
SwapCached:          0 kB
Active:        4495212 kB
Inactive:      9474784 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18400156 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           46292 kB
Writeback:           0 kB
AnonPages:      132800 kB
Mapped:          15972 kB
Slab:           515596 kB
PageTables:       5576 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   318604 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 70940 MiB
End job on node103 at 2011-04-26 02:15:26