Trace number 3190898

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.19 1201.81

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S1275797759-041-UNKNOWN.cnf
MD5SUM374e3ba6783d13d6d478972802d8dba0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3190898-1304042761/watcher-3190898-1304042761 -o /tmp/evaluation-result-3190898-1304042761/solver-3190898-1304042761 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3190898-1304042761.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.41 10.51 9.35 7/187 26591
/proc/meminfo: memFree=26635756/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0

[startup+0.422236 s]
/proc/loadavg: 10.41 10.51 9.35 7/187 26591
/proc/meminfo: memFree=26635756/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.500223 s]
/proc/loadavg: 10.41 10.51 9.35 7/187 26591
/proc/meminfo: memFree=26635756/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.600204 s]
/proc/loadavg: 10.41 10.51 9.35 7/187 26591
/proc/meminfo: memFree=26635756/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700185 s]
/proc/loadavg: 10.41 10.51 9.35 7/187 26591
/proc/meminfo: memFree=26635756/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50704 s]
/proc/loadavg: 10.41 10.51 9.35 12/193 26601
/proc/meminfo: memFree=26575136/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=28368 CPUtime=1.49 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 5538 0 0 0 149 0 0 0 25 0 1 0 496691631 29048832 2444 33554432000 4194304 4587354 140733410964736 18446744073709551615 4238543 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 7092 2444 326 96 0 3654 0
[pid=26593] ppid=26591 vsize=24304 CPUtime=1.49 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 3668 0 0 0 149 0 0 0 25 0 1 0 496691631 24887296 3400 33554432000 4194304 4785740 140734594157248 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 6076 3400 340 145 0 3121 0
[pid=26594] ppid=26591 vsize=456220 CPUtime=0.79 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1457 0 0 0 79 0 0 0 25 0 1 0 496691631 467169280 1354 33554432000 134512640 134534564 4288351632 18446744073709551615 134524573 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 114055 1354 91 6 0 112721 0
[pid=26595] ppid=26591 vsize=7096 CPUtime=1.49 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 1905 0 0 0 149 0 0 0 25 0 1 0 496691631 7266304 968 33554432000 4194304 4352236 140734580256928 18446744073709551615 4328085 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 1774 968 127 39 0 854 0
[pid=26596] ppid=26591 vsize=12556 CPUtime=0.69 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 6381 0 0 0 69 0 0 0 25 0 1 0 496691631 12857344 1361 33554432000 4194304 4331988 140736557120656 18446744073709551615 4271172 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 3139 1361 150 34 0 1581 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 546868

[startup+3.10074 s]
/proc/loadavg: 10.41 10.51 9.35 12/193 26603
/proc/meminfo: memFree=26539372/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=975592 CPUtime=3.08 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 9213 0 0 0 307 1 0 0 25 0 1 0 496691631 999006208 2703 33554432000 4194304 4587354 140733410964736 18446744073709551615 4238647 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 243898 2703 327 96 0 240460 0
[pid=26593] ppid=26591 vsize=25540 CPUtime=3.09 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 3961 0 0 0 309 0 0 0 25 0 1 0 496691631 26152960 3693 33554432000 4194304 4785740 140734594157248 18446744073709551615 4278133 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 6385 3693 340 145 0 3430 0
[pid=26594] ppid=26591 vsize=456220 CPUtime=1.57 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1457 0 0 0 157 0 0 0 25 0 1 0 496691631 467169280 1354 33554432000 134512640 134534564 4288351632 18446744073709551615 134524700 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 114055 1354 91 6 0 112721 0
[pid=26595] ppid=26591 vsize=7484 CPUtime=3.08 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 2501 0 0 0 308 0 0 0 25 0 1 0 496691631 7663616 1052 33554432000 4194304 4352236 140734580256928 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 1871 1052 127 39 0 951 0
[pid=26596] ppid=26591 vsize=12556 CPUtime=1.49 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 6381 0 0 0 149 0 0 0 25 0 1 0 496691631 12857344 1361 33554432000 4194304 4331988 140736557120656 18446744073709551615 4226642 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 3139 1361 150 34 0 1581 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 1495716

[startup+6.30115 s]
/proc/loadavg: 10.46 10.52 9.36 12/193 26615
/proc/meminfo: memFree=26481780/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=994396 CPUtime=6.29 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 15111 0 0 0 627 2 0 0 25 0 1 0 496691631 1018261504 7138 33554432000 4194304 4587354 140733410964736 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 248599 7138 337 96 0 245161 0
[pid=26593] ppid=26591 vsize=27968 CPUtime=6.29 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 4555 0 0 0 629 0 0 0 25 0 1 0 496691631 28639232 4287 33554432000 4194304 4785740 140734594157248 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 6992 4287 340 145 0 4037 0
[pid=26594] ppid=26591 vsize=456220 CPUtime=3.16 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1457 0 0 0 316 0 0 0 25 0 1 0 496691631 467169280 1354 33554432000 134512640 134534564 4288351632 18446744073709551615 134524577 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 114055 1354 91 6 0 112721 0
[pid=26595] ppid=26591 vsize=8652 CPUtime=6.28 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 3302 0 0 0 628 0 0 0 25 0 1 0 496691631 8859648 1341 33554432000 4194304 4352236 140734580256928 18446744073709551615 4328832 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 2163 1341 127 39 0 1243 0
[pid=26596] ppid=26591 vsize=17024 CPUtime=3.09 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 7762 0 0 0 309 0 0 0 25 0 1 0 496691631 17432576 2242 33554432000 4194304 4331988 140736557120656 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 4256 2242 174 34 0 2698 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 1522584

[startup+12.701 s]
/proc/loadavg: 10.50 10.52 9.37 12/193 26659
/proc/meminfo: memFree=26341232/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=1006356 CPUtime=12.69 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 21847 0 0 0 1266 3 0 0 25 0 1 0 496691631 1030508544 12300 33554432000 4194304 4587354 140733410964736 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 251589 12300 337 96 0 248151 0
[pid=26593] ppid=26591 vsize=31892 CPUtime=12.68 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 5504 0 0 0 1268 0 0 0 25 0 1 0 496691631 32657408 5236 33554432000 4194304 4785740 140734594157248 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 7973 5236 340 145 0 5018 0
[pid=26594] ppid=26591 vsize=456220 CPUtime=6.32 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1457 0 0 0 632 0 0 0 25 0 1 0 496691631 467169280 1354 33554432000 134512640 134534564 4288351632 18446744073709551615 134524554 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 114055 1354 91 6 0 112721 0
[pid=26595] ppid=26591 vsize=11156 CPUtime=12.68 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 4455 0 0 0 1267 1 0 0 25 0 1 0 496691631 11423744 1982 33554432000 4194304 4352236 140734580256928 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 2789 1982 127 39 0 1869 0
[pid=26596] ppid=26591 vsize=17024 CPUtime=6.29 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 7763 0 0 0 629 0 0 0 25 0 1 0 496691631 17432576 2243 33554432000 4194304 4331988 140736557120656 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 4256 2243 174 34 0 2698 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 1540972

[startup+25.5006 s]
/proc/loadavg: 10.61 10.55 9.39 12/194 26718
/proc/meminfo: memFree=26380004/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=1006336 CPUtime=25.49 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 30337 0 0 0 2545 4 0 0 25 0 1 0 496691631 1030488064 13235 33554432000 4194304 4587354 140733410964736 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 251584 13235 337 96 0 248146 0
[pid=26593] ppid=26591 vsize=36940 CPUtime=25.49 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 6716 0 0 0 2548 1 0 0 25 0 1 0 496691631 37826560 6448 33554432000 4194304 4785740 140734594157248 18446744073709551615 4287168 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 9235 6448 340 145 0 6280 0
[pid=26594] ppid=26591 vsize=460708 CPUtime=12.7 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1816 0 0 0 1270 0 0 0 25 0 1 0 496691631 471764992 1713 33554432000 134512640 134534564 4288351632 18446744073709551615 134530329 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 115177 1713 95 6 0 113843 0
[pid=26595] ppid=26591 vsize=8984 CPUtime=25.47 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 5256 0 0 0 2546 1 0 0 25 0 1 0 496691631 9199616 1439 33554432000 4194304 4352236 140734580256928 18446744073709551615 4328109 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 2246 1439 127 39 0 1326 0
[pid=26596] ppid=26591 vsize=17024 CPUtime=12.64 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 7763 0 0 0 1264 0 0 0 25 0 1 0 496691631 17432576 2243 33554432000 4194304 4331988 140736557120656 18446744073709551615 228094846338 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 4256 2243 174 34 0 2698 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 1548316

[startup+51.1009 s]
/proc/loadavg: 10.88 10.61 9.44 12/193 26803
/proc/meminfo: memFree=26219508/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=1010120 CPUtime=51.09 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 47687 0 0 0 5099 10 0 0 25 0 1 0 496691631 1034362880 11581 33554432000 4194304 4587354 140733410964736 18446744073709551615 4388261 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 252530 11581 337 96 0 249092 0
[pid=26593] ppid=26591 vsize=43988 CPUtime=51.09 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 8393 0 0 0 5108 1 0 0 25 0 1 0 496691631 45043712 8125 33554432000 4194304 4785740 140734594157248 18446744073709551615 4278093 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 10997 8125 340 145 0 8042 0
[pid=26594] ppid=26591 vsize=460708 CPUtime=25.41 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1816 0 0 0 2541 0 0 0 25 0 1 0 496691631 471764992 1713 33554432000 134512640 134534564 4288351632 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 115177 1713 95 6 0 113843 0
[pid=26595] ppid=26591 vsize=9628 CPUtime=51.05 cores=2

################
# More data... #
################

/proc/26596/statm: 14079 11778 175 34 0 12521 0
Current children cumulated CPU time (s) 3523.92
Current children cumulated vsize (KiB) 1658588

[startup+942.3 s]
/proc/loadavg: 10.20 10.49 10.19 11/188 28373
/proc/meminfo: memFree=25865508/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=990728 CPUtime=942.12 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 374317 0 0 0 94081 131 0 0 25 0 1 0 496691631 1014505472 14223 33554432000 4194304 4587354 140733410964736 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 247682 14223 337 96 0 244244 0
[pid=26593] ppid=26591 vsize=109084 CPUtime=942.3 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 23226 0 0 0 94225 5 0 0 25 0 1 0 496691631 111702016 22958 33554432000 4194304 4785740 140734594157248 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 27271 22958 340 145 0 24316 0
[pid=26594] ppid=26591 vsize=460708 CPUtime=468.63 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1816 0 0 0 46863 0 0 0 25 0 1 0 496691631 471764992 1713 33554432000 134512640 134534564 4288351632 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 115177 1713 95 6 0 113843 0
[pid=26595] ppid=26591 vsize=17316 CPUtime=941.99 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 34541 0 0 0 94178 21 0 0 25 0 1 0 496691631 17731584 3523 33554432000 4194304 4352236 140734580256928 18446744073709551615 4328181 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 4329 3523 127 39 0 3409 0
[pid=26596] ppid=26591 vsize=75960 CPUtime=468.53 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 18020 0 0 0 46849 4 0 0 25 0 1 0 496691631 77783040 12500 33554432000 4194304 4331988 140736557120656 18446744073709551615 4287447 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 18990 12500 175 34 0 17432 0
Current children cumulated CPU time (s) 3763.57
Current children cumulated vsize (KiB) 1672120

[startup+1002.3 s]
/proc/loadavg: 10.29 10.45 10.19 11/188 28375
/proc/meminfo: memFree=25830972/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=1051816 CPUtime=1002.12 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 400194 0 0 0 100074 138 0 0 25 0 1 0 496691631 1077059584 23262 33554432000 4194304 4587354 140733410964736 18446744073709551615 4365225 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 262954 23262 337 96 0 259516 0
[pid=26593] ppid=26591 vsize=110552 CPUtime=1002.31 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 23556 0 0 0 100226 5 0 0 25 0 1 0 496691631 113205248 23288 33554432000 4194304 4785740 140734594157248 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 27638 23288 340 145 0 24683 0
[pid=26594] ppid=26591 vsize=460708 CPUtime=498.43 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1816 0 0 0 49843 0 0 0 25 0 1 0 496691631 471764992 1713 33554432000 134512640 134534564 4288351632 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 115177 1713 95 6 0 113843 0
[pid=26595] ppid=26591 vsize=17828 CPUtime=1001.98 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 35693 0 0 0 100177 21 0 0 25 0 1 0 496691631 18255872 3651 33554432000 4194304 4352236 140734580256928 18446744073709551615 4328013 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 4457 3651 127 39 0 3537 0
[pid=26596] ppid=26591 vsize=75960 CPUtime=498.42 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 18681 0 0 0 49837 5 0 0 25 0 1 0 496691631 77783040 13161 33554432000 4194304 4331988 140736557120656 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 18990 13161 175 34 0 17432 0
Current children cumulated CPU time (s) 4003.26
Current children cumulated vsize (KiB) 1735188

[startup+1062.3 s]
/proc/loadavg: 10.25 10.39 10.19 11/188 28377
/proc/meminfo: memFree=25899528/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=1026392 CPUtime=1062.12 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 417570 0 0 0 106067 145 0 0 25 0 1 0 496691631 1051025408 8818 33554432000 4194304 4587354 140733410964736 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 256598 8818 337 96 0 253160 0
[pid=26593] ppid=26591 vsize=114840 CPUtime=1062.3 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 24525 0 0 0 106225 5 0 0 25 0 1 0 496691631 117596160 24257 33554432000 4194304 4785740 140734594157248 18446744073709551615 4287143 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 28710 24257 340 145 0 25755 0
[pid=26594] ppid=26591 vsize=460708 CPUtime=528.31 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1816 0 0 0 52831 0 0 0 25 0 1 0 496691631 471764992 1713 33554432000 134512640 134534564 4288351632 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 115177 1713 95 6 0 113843 0
[pid=26595] ppid=26591 vsize=17700 CPUtime=1061.98 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 37837 0 0 0 106176 22 0 0 25 0 1 0 496691631 18124800 3619 33554432000 4194304 4352236 140734580256928 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 4425 3619 127 39 0 3505 0
[pid=26596] ppid=26591 vsize=75960 CPUtime=528.22 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 19287 0 0 0 52817 5 0 0 25 0 1 0 496691631 77783040 13767 33554432000 4194304 4331988 140736557120656 18446744073709551615 4226260 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 18990 13767 175 34 0 17432 0
Current children cumulated CPU time (s) 4242.93
Current children cumulated vsize (KiB) 1713924

[startup+1122.3 s]
/proc/loadavg: 10.28 10.37 10.19 11/188 28378
/proc/meminfo: memFree=25841852/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=1869988 CPUtime=1122.13 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 437471 0 0 0 112060 153 0 0 25 0 1 0 496691631 1914867712 10926 33554432000 4194304 4587354 140733410964736 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 467497 10926 337 96 0 464059 0
[pid=26593] ppid=26591 vsize=116660 CPUtime=1122.32 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 24909 0 0 0 112226 6 0 0 25 0 1 0 496691631 119459840 24641 33554432000 4194304 4785740 140734594157248 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 29165 24641 340 145 0 26210 0
[pid=26594] ppid=26591 vsize=460708 CPUtime=558.12 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1816 0 0 0 55812 0 0 0 25 0 1 0 496691631 471764992 1713 33554432000 134512640 134534564 4288351632 18446744073709551615 134528902 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 115177 1713 95 6 0 113843 0
[pid=26595] ppid=26591 vsize=21412 CPUtime=1121.98 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 40941 0 0 0 112176 22 0 0 25 0 1 0 496691631 21925888 4547 33554432000 4194304 4352236 140734580256928 18446744073709551615 4235610 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 5353 4547 127 39 0 4433 0
[pid=26596] ppid=26591 vsize=75960 CPUtime=558.08 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 19916 0 0 0 55803 5 0 0 25 0 1 0 496691631 77783040 14396 33554432000 4194304 4331988 140736557120656 18446744073709551615 4226539 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 18990 14396 175 34 0 17432 0
Current children cumulated CPU time (s) 4482.63
Current children cumulated vsize (KiB) 2563052

[startup+1182.3 s]
/proc/loadavg: 10.57 10.42 10.21 11/188 28383
/proc/meminfo: memFree=25850556/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=1870104 CPUtime=1182.13 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 456603 0 0 0 118050 163 0 0 25 0 1 0 496691631 1914986496 11827 33554432000 4194304 4587354 140733410964736 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 467526 11827 337 96 0 464088 0
[pid=26593] ppid=26591 vsize=120140 CPUtime=1182.31 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 25719 0 0 0 118225 6 0 0 25 0 1 0 496691631 123023360 25451 33554432000 4194304 4785740 140734594157248 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 30035 25451 340 145 0 27080 0
[pid=26594] ppid=26591 vsize=460708 CPUtime=587.97 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1816 0 0 0 58797 0 0 0 25 0 1 0 496691631 471764992 1713 33554432000 134512640 134534564 4288351632 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 115177 1713 95 6 0 113843 0
[pid=26595] ppid=26591 vsize=21412 CPUtime=1181.96 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 42093 0 0 0 118174 22 0 0 25 0 1 0 496691631 21925888 4547 33554432000 4194304 4352236 140734580256928 18446744073709551615 4278721 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 5353 4547 127 39 0 4433 0
[pid=26596] ppid=26591 vsize=75960 CPUtime=587.9 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 20559 0 0 0 58785 5 0 0 25 0 1 0 496691631 77783040 15039 33554432000 4194304 4331988 140736557120656 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 18990 15039 175 34 0 17432 0
Current children cumulated CPU time (s) 4722.27
Current children cumulated vsize (KiB) 2566648



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 10.41 10.39 10.21 6/182 28384
/proc/meminfo: memFree=26366052/32951124 swapFree=67111524/67111528
[pid=26591] ppid=26589 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/26591/stat : 26591 (ppfolio) S 26589 26591 25547 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 496691631 18763776 390 33554432000 4194304 4287625 140734314356144 18446744073709551615 228095471119 0 0 4096 65536 17714478267437678591 0 0 17 4 0 0 0
/proc/26591/statm: 4581 390 341 23 0 91 0
[pid=26592] ppid=26591 vsize=1014340 CPUtime=1201.64 cores=0
/proc/26592/stat : 26592 (cryptominisat) R 26591 26591 25547 0 -1 4202496 463107 0 0 0 119997 167 0 0 25 0 1 0 496691631 1038684160 9077 33554432000 4194304 4587354 140733410964736 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26592/statm: 253585 9077 337 96 0 250147 0
[pid=26593] ppid=26591 vsize=121044 CPUtime=1201.82 cores=4
/proc/26593/stat : 26593 (clasp) R 26591 26591 25547 0 -1 4202496 25946 0 0 0 120176 6 0 0 25 0 1 0 496691631 123949056 25678 33554432000 4194304 4785740 140734594157248 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26593/statm: 30261 25678 340 145 0 27306 0
[pid=26594] ppid=26591 vsize=460708 CPUtime=597.66 cores=6
/proc/26594/stat : 26594 (TNM) R 26591 26591 25547 0 -1 4202496 1816 0 0 0 59766 0 0 0 25 0 1 0 496691631 471764992 1713 33554432000 134512640 134534564 4288351632 18446744073709551615 134530504 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26594/statm: 115177 1713 95 6 0 113843 0
[pid=26595] ppid=26591 vsize=21412 CPUtime=1201.47 cores=2
/proc/26595/stat : 26595 (lingeling) R 26591 26591 25547 0 -1 4202496 42093 0 0 0 120125 22 0 0 25 0 1 0 496691631 21925888 4547 33554432000 4194304 4352236 140734580256928 18446744073709551615 4328159 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/26595/statm: 5353 4547 127 39 0 4433 0
[pid=26596] ppid=26591 vsize=75960 CPUtime=597.6 cores=6
/proc/26596/stat : 26596 (march_hi) R 26591 26591 25547 0 -1 4202496 20774 0 0 0 59755 5 0 0 25 0 1 0 496691631 77783040 15254 33554432000 4194304 4331988 140736557120656 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/26596/statm: 18990 15254 175 34 0 17432 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 1711788

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26591 and gives
#  childrusage.ru_utime.tv_sec=2998
#  childrusage.ru_utime.tv_usec=893098
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=909709
# CPU time returned by wait4() is 3000.8
# while last known CPU time is 4800.19
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.81
CPU time (s): 4800.19
CPU user time (s): 4798.19
CPU system time (s): 2
CPU usage (%): 399.412
Max. virtual memory (cumulated for all children) (KiB): 2633612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2998.89
system time used= 1.90971
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 507539
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 373
involuntary context switches= 25441

runsolver used 1.91071 second user time and 4.65629 second system time

The end

Launcher Data 

Begin job on node142 at 2011-04-29 04:06:02
IDJOB=3190898
IDBENCH=82629
IDSOLVER=1612
FILE ID=node142/3190898-1304042761
RUNJOBID= node142-1304041557-25982
PBS_JOBID= 13170374
Free space on /tmp= 71300 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S1275797759-041-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3190898-1304042761/watcher-3190898-1304042761 -o /tmp/evaluation-result-3190898-1304042761/solver-3190898-1304042761 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3190898-1304042761.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 374e3ba6783d13d6d478972802d8dba0
RANDOM SEED=1019614855

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26636160 kB
Buffers:       1641324 kB
Cached:        4016668 kB
SwapCached:          4 kB
Active:         713052 kB
Inactive:      5062228 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26636160 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           23584 kB
Writeback:           0 kB
AnonPages:      117128 kB
Mapped:          16956 kB
Slab:           474464 kB
PageTables:       5768 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   716948 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71292 MiB
End job on node142 at 2011-04-29 04:26:05