Trace number 3191364

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.33 1201.71

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v600-c2556-S1885965779-049.UNKNOWN.cnf
MD5SUM465b21028c8505bfc2ee7974d056b900
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses2556
Sum of the clauses size7668
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32556
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191364-1304079310/watcher-3191364-1304079310 -o /tmp/evaluation-result-3191364-1304079310/solver-3191364-1304079310 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191364-1304079310.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.00 9.52 9.35 6/186 1160
/proc/meminfo: memFree=30708296/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 18 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0

[startup+1.19931 s]
/proc/loadavg: 10.00 9.52 9.35 6/186 1160
/proc/meminfo: memFree=30708296/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.20109 s]
/proc/loadavg: 10.00 9.52 9.35 6/186 1160
/proc/meminfo: memFree=30708296/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.36905 s]
/proc/loadavg: 10.00 9.52 9.35 6/186 1160
/proc/meminfo: memFree=30708296/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.40105 s]
/proc/loadavg: 10.00 9.52 9.35 6/186 1160
/proc/meminfo: memFree=30708296/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.56902 s]
/proc/loadavg: 10.00 9.52 9.35 6/186 1160
/proc/meminfo: memFree=30708296/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10074 s]
/proc/loadavg: 10.24 9.58 9.37 11/192 1166
/proc/meminfo: memFree=30689920/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1737356 CPUtime=3.09 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 4976 0 0 0 308 1 0 0 25 0 1 0 519528922 1779052544 2771 33554432000 4194304 4587354 140736930948640 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 434339 2771 337 96 0 430901 0
[pid=1162] ppid=1160 vsize=15244 CPUtime=3.09 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 1261 0 0 0 309 0 0 0 25 0 1 0 519528922 15609856 1147 33554432000 4194304 4785740 140734259978032 18446744073709551615 4552530 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 3811 1147 340 145 0 856 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=1.97 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 197 0 0 0 21 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134528473 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=6468 CPUtime=3.09 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 1622 0 0 0 309 0 0 0 25 0 1 0 519528922 6623232 816 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328979 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 1617 816 127 39 0 697 0
[pid=1165] ppid=1160 vsize=8136 CPUtime=1.11 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 649 0 0 0 111 0 0 0 25 0 1 0 519528922 8331264 541 33554432000 4194304 4331988 140734009880384 18446744073709551615 4211509 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 2034 541 173 34 0 476 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 2241488

[startup+6.30116 s]
/proc/loadavg: 10.22 9.58 9.37 11/192 1166
/proc/meminfo: memFree=30690328/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1744564 CPUtime=6.29 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 7336 0 0 0 628 1 0 0 25 0 1 0 519528922 1786433536 2832 33554432000 4194304 4587354 140736930948640 18446744073709551615 4238622 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 436141 2832 337 96 0 432703 0
[pid=1162] ppid=1160 vsize=16312 CPUtime=6.29 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 1544 0 0 0 629 0 0 0 25 0 1 0 519528922 16703488 1430 33554432000 4194304 4785740 140734259978032 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 4078 1430 340 145 0 1123 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=3.55 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 355 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134529775 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=6788 CPUtime=6.29 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 2246 0 0 0 629 0 0 0 25 0 1 0 519528922 6950912 896 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 1697 896 127 39 0 777 0
[pid=1165] ppid=1160 vsize=8544 CPUtime=2.71 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 721 0 0 0 271 0 0 0 25 0 1 0 519528922 8749056 613 33554432000 4194304 4331988 140734009880384 18446744073709551615 4237144 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 2136 613 173 34 0 578 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 2250492

[startup+12.701 s]
/proc/loadavg: 10.20 9.59 9.37 11/192 1166
/proc/meminfo: memFree=30675188/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1747076 CPUtime=12.68 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 12027 0 0 0 1267 1 0 0 25 0 1 0 519528922 1789005824 4734 33554432000 4194304 4587354 140736930948640 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 436769 4734 337 96 0 433331 0
[pid=1162] ppid=1160 vsize=17736 CPUtime=12.69 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 1898 0 0 0 1269 0 0 0 25 0 1 0 519528922 18161664 1784 33554432000 4194304 4785740 140734259978032 18446744073709551615 4287249 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 4434 1784 341 145 0 1479 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=6.74 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 674 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134528972 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=8200 CPUtime=12.69 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 3367 0 0 0 1269 0 0 0 25 0 1 0 519528922 8396800 1249 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328248 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 2050 1249 127 39 0 1130 0
[pid=1165] ppid=1160 vsize=9112 CPUtime=5.88 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 857 0 0 0 588 0 0 0 25 0 1 0 519528922 9330688 749 33554432000 4194304 4331988 140734009880384 18446744073709551615 4211487 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 2278 749 173 34 0 720 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 2256408

[startup+25.5007 s]
/proc/loadavg: 10.24 9.62 9.38 12/192 1166
/proc/meminfo: memFree=30667880/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1747400 CPUtime=25.49 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 16851 0 0 0 2547 2 0 0 25 0 1 0 519528922 1789337600 5191 33554432000 4194304 4587354 140736930948640 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 436850 5191 337 96 0 433412 0
[pid=1162] ppid=1160 vsize=19860 CPUtime=25.49 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 2416 0 0 0 2549 0 0 0 25 0 1 0 519528922 20336640 2302 33554432000 4194304 4785740 140734259978032 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 4965 2302 341 145 0 2010 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=13.14 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 1314 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134530260 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=11144 CPUtime=25.48 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 6119 0 0 0 2548 0 0 0 25 0 1 0 519528922 11411456 1985 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328349 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 2786 1985 127 39 0 1866 0
[pid=1165] ppid=1160 vsize=10664 CPUtime=12.21 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 1129 0 0 0 1221 0 0 0 25 0 1 0 519528922 10919936 1021 33554432000 4194304 4331988 140734009880384 18446744073709551615 4316920 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 2666 1021 173 34 0 1108 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 2263352

[startup+51.101 s]
/proc/loadavg: 10.45 9.73 9.43 11/192 1167
/proc/meminfo: memFree=30649712/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1750292 CPUtime=51.08 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 24795 0 0 0 5105 3 0 0 25 0 1 0 519528922 1792299008 5320 33554432000 4194304 4587354 140736930948640 18446744073709551615 4239304 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 437573 5320 337 96 0 434135 0
[pid=1162] ppid=1160 vsize=22940 CPUtime=51.09 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 3149 0 0 0 5109 0 0 0 25 0 1 0 519528922 23490560 3035 33554432000 4194304 4785740 140734259978032 18446744073709551615 4553029 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 5735 3035 341 145 0 2780 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=25.84 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 2584 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134529632 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=12172 CPUtime=51.09 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 10440 0 0 0 5108 1 0 0 25 0 1 0 519528922 12464128 2242 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 3043 2242 127 39 0 2123 0
[pid=1165] ppid=1160 vsize=12088 CPUtime=24.97 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 1618 0 0 0 2497 0 0 0 25 0 1 0 519528922 12378112 1510 33554432000 4194304 4331988 140734009880384 18446744073709551615 4315979 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 3022 1510 173 34 0 1464 0
Current children cumulated CPU time (s) 204.07
Current children cumulated vsize (KiB) 2271776

[startup+102.307 s]
/proc/loadavg: 10.38 9.82 9.47 11/192 1168
/proc/meminfo: memFree=30630588/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1759896 CPUtime=102.3 cores=1

################
# More data... #
################

/proc/1165/statm: 21173 15372 173 34 0 19615 0
Current children cumulated CPU time (s) 3524.43
Current children cumulated vsize (KiB) 2474228

[startup+942.301 s]
/proc/loadavg: 9.70 10.06 9.87 10/191 1224
/proc/meminfo: memFree=30265696/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1820864 CPUtime=942.31 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 133316 0 0 0 94186 45 0 0 25 0 1 0 519528922 1864564736 24099 33554432000 4194304 4587354 140736930948640 18446744073709551615 4244447 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 455216 24099 337 96 0 451778 0
[pid=1162] ppid=1160 vsize=45760 CPUtime=942.3 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 8424 0 0 0 94229 1 0 0 25 0 1 0 519528922 46858240 8310 33554432000 4194304 4785740 140734259978032 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 11440 8310 341 145 0 8485 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=469.07 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 46907 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134529758 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=33112 CPUtime=942.31 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 79883 0 0 0 94220 11 0 0 25 0 1 0 519528922 33906688 7477 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 8278 7477 127 39 0 7358 0
[pid=1165] ppid=1160 vsize=84824 CPUtime=468.1 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 16449 0 0 0 46802 8 0 0 25 0 1 0 519528922 86859776 16341 33554432000 4194304 4331988 140734009880384 18446744073709551615 4237130 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 21206 16341 173 34 0 19648 0
Current children cumulated CPU time (s) 3764.09
Current children cumulated vsize (KiB) 2458844

[startup+1002.3 s]
/proc/loadavg: 9.52 9.93 9.84 10/191 1225
/proc/meminfo: memFree=30197472/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=190764 CPUtime=1002.32 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 137699 0 0 0 100184 48 0 0 25 0 1 0 519528922 195342336 28194 33554432000 4194304 4587354 140736930948640 18446744073709551615 4231904 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 47691 28194 337 96 0 44253 0
[pid=1162] ppid=1160 vsize=46220 CPUtime=1002.3 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 8500 0 0 0 100229 1 0 0 25 0 1 0 519528922 47329280 8386 33554432000 4194304 4785740 140734259978032 18446744073709551615 4553083 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 11555 8386 341 145 0 8600 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=498.92 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 49892 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=31320 CPUtime=1002.31 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 84235 0 0 0 100220 11 0 0 25 0 1 0 519528922 32071680 7029 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 7830 7029 127 39 0 6910 0
[pid=1165] ppid=1160 vsize=84824 CPUtime=497.93 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 17392 0 0 0 49784 9 0 0 25 0 1 0 519528922 86859776 17284 33554432000 4194304 4331988 140734009880384 18446744073709551615 4229616 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 21206 17284 173 34 0 19648 0
Current children cumulated CPU time (s) 4003.78
Current children cumulated vsize (KiB) 827412

[startup+1062.3 s]
/proc/loadavg: 9.35 9.80 9.80 10/191 1227
/proc/meminfo: memFree=30191000/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1827900 CPUtime=1062.32 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 137995 0 0 0 106184 48 0 0 25 0 1 0 519528922 1871769600 24554 33554432000 4194304 4587354 140736930948640 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 456975 24554 337 96 0 453537 0
[pid=1162] ppid=1160 vsize=47028 CPUtime=1062.3 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 8706 0 0 0 106229 1 0 0 25 0 1 0 519528922 48156672 8592 33554432000 4194304 4785740 140734259978032 18446744073709551615 4287168 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 11757 8592 341 145 0 8802 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=528.76 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 52876 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134528748 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=25944 CPUtime=1062.32 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 86315 0 0 0 106220 12 0 0 25 0 1 0 519528922 26566656 5685 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 6486 5685 127 39 0 5566 0
[pid=1165] ppid=1160 vsize=84824 CPUtime=527.76 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 18304 0 0 0 52767 9 0 0 25 0 1 0 519528922 86859776 18196 33554432000 4194304 4331988 140734009880384 18446744073709551615 4226479 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 21206 18196 173 34 0 19648 0
Current children cumulated CPU time (s) 4243.46
Current children cumulated vsize (KiB) 2459980

[startup+1122.3 s]
/proc/loadavg: 9.45 9.73 9.77 10/191 1229
/proc/meminfo: memFree=30165800/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1820864 CPUtime=1122.32 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 142467 0 0 0 112181 51 0 0 25 0 1 0 519528922 1864564736 24443 33554432000 4194304 4587354 140736930948640 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 455216 24443 337 96 0 451778 0
[pid=1162] ppid=1160 vsize=47504 CPUtime=1122.3 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 8809 0 0 0 112229 1 0 0 25 0 1 0 519528922 48644096 8695 33554432000 4194304 4785740 140734259978032 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 11876 8695 341 145 0 8921 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=558.58 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 55858 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 7637344 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=31320 CPUtime=1122.32 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 92459 0 0 0 112220 12 0 0 25 0 1 0 519528922 32071680 7029 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 7830 7029 127 39 0 6910 0
[pid=1165] ppid=1160 vsize=114292 CPUtime=557.62 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 19263 0 0 0 55752 10 0 0 25 0 1 0 519528922 117035008 19155 33554432000 4194304 4331988 140734009880384 18446744073709551615 4229665 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 28573 19155 173 34 0 27015 0
Current children cumulated CPU time (s) 4483.14
Current children cumulated vsize (KiB) 2488264

[startup+1182.3 s]
/proc/loadavg: 9.37 9.66 9.74 10/191 1230
/proc/meminfo: memFree=30136384/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1820864 CPUtime=1182.32 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 146898 0 0 0 118179 53 0 0 25 0 1 0 519528922 1864564736 24445 33554432000 4194304 4587354 140736930948640 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 455216 24445 337 96 0 451778 0
[pid=1162] ppid=1160 vsize=48252 CPUtime=1182.31 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 8985 0 0 0 118230 1 0 0 25 0 1 0 519528922 49410048 8871 33554432000 4194304 4785740 140734259978032 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 12063 8871 341 145 0 9108 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=588.45 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 58845 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134529080 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=33112 CPUtime=1182.32 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 96331 0 0 0 118219 13 0 0 25 0 1 0 519528922 33906688 7477 33554432000 4194304 4352236 140735333490032 18446744073709551615 4329047 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 8278 7477 127 39 0 7358 0
[pid=1165] ppid=1160 vsize=114292 CPUtime=587.42 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 20260 0 0 0 58731 11 0 0 25 0 1 0 519528922 117035008 20152 33554432000 4194304 4331988 140734009880384 18446744073709551615 4211493 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 28573 20152 173 34 0 27015 0
Current children cumulated CPU time (s) 4722.82
Current children cumulated vsize (KiB) 2490804



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 9.40 9.65 9.73 11/191 1231
/proc/meminfo: memFree=30133892/32951124 swapFree=67111344/67111528
[pid=1160] ppid=1158 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1160/stat : 1160 (ppfolio) S 1158 1160 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519528922 18763776 390 33554432000 4194304 4287625 140737056589328 18446744073709551615 271550557711 0 0 4096 65536 4503960134040420351 0 0 17 1 0 0 0
/proc/1160/statm: 4581 390 341 23 0 91 0
[pid=1161] ppid=1160 vsize=1820864 CPUtime=1201.72 cores=1
/proc/1161/stat : 1161 (cryptominisat) R 1160 1160 379 0 -1 4202496 147021 0 0 0 120119 53 0 0 25 0 1 0 519528922 1864564736 24566 33554432000 4194304 4587354 140736930948640 18446744073709551615 4238525 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1161/statm: 455216 24566 337 96 0 451778 0
[pid=1162] ppid=1160 vsize=48424 CPUtime=1201.71 cores=5
/proc/1162/stat : 1162 (clasp) R 1160 1160 379 0 -1 4202496 9009 0 0 0 120170 1 0 0 25 0 1 0 519528922 49586176 8895 33554432000 4194304 4785740 140734259978032 18446744073709551615 4287249 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1162/statm: 12106 8895 341 145 0 9151 0
[pid=1163] ppid=1160 vsize=455960 CPUtime=598.06 cores=7
/proc/1163/stat : 1163 (TNM) R 1160 1160 379 0 -1 4202496 357 0 0 0 59806 0 0 0 25 0 1 0 519528922 466903040 253 33554432000 134512640 134534564 4292506320 18446744073709551615 134530484 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1163/statm: 113990 253 95 6 0 112656 0
[pid=1164] ppid=1160 vsize=28632 CPUtime=1201.73 cores=3
/proc/1164/stat : 1164 (lingeling) R 1160 1160 379 0 -1 4202496 97259 0 0 0 120160 13 0 0 25 0 1 0 519528922 29319168 6357 33554432000 4194304 4352236 140735333490032 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1164/statm: 7158 6357 127 39 0 6238 0
[pid=1165] ppid=1160 vsize=114292 CPUtime=597.11 cores=7
/proc/1165/stat : 1165 (march_hi) R 1160 1160 379 0 -1 4202496 20577 0 0 0 59700 11 0 0 25 0 1 0 519528922 117035008 20469 33554432000 4194304 4331988 140734009880384 18446744073709551615 4211461 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1165/statm: 28573 20469 173 34 0 27015 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 2486496

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1160 and gives
#  childrusage.ru_utime.tv_sec=1799
#  childrusage.ru_utime.tv_usec=772393
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=28995
# CPU time returned by wait4() is 1799.8
# while last known CPU time is 4800.33
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.33
CPU user time (s): 4799.55
CPU system time (s): 0.78
CPU usage (%): 399.457
Max. virtual memory (cumulated for all children) (KiB): 4153044

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.77
system time used= 0.028995
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9904
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 537
involuntary context switches= 27205

runsolver used 1.9457 second user time and 4.6123 second system time

The end

Launcher Data 

Begin job on node133 at 2011-04-29 14:15:10
IDJOB=3191364
IDBENCH=83095
IDSOLVER=1612
FILE ID=node133/3191364-1304079310
RUNJOBID= node133-1304077694-398
PBS_JOBID= 13170511
Free space on /tmp= 71888 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v600-c2556-S1885965779-049.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191364-1304079310/watcher-3191364-1304079310 -o /tmp/evaluation-result-3191364-1304079310/solver-3191364-1304079310 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191364-1304079310.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 465b21028c8505bfc2ee7974d056b900
RANDOM SEED=1638231953

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30708452 kB
Buffers:        736468 kB
Cached:         969932 kB
SwapCached:        124 kB
Active:         723604 kB
Inactive:      1160844 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30708452 kB
SwapTotal:    67111528 kB
SwapFree:     67111344 kB
Dirty:           10012 kB
Writeback:           0 kB
AnonPages:      178088 kB
Mapped:          16768 kB
Slab:           294592 kB
PageTables:       5384 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  4575480 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71868 MiB
End job on node133 at 2011-04-29 14:35:14