Trace number 3191515

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1299.84 1300.01

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v20000-c84000-S1298436766-097-UNKNOWN.cnf
MD5SUM28b704f4b0f31dccf5e0c8fedfb14daa
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark60.2658
Satisfiable
(Un)Satisfiability was proved
Number of variables20000
Number of clauses84000
Sum of the clauses size252000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 384000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.20	This is pico-portfolio, a naive parallel portfolio
0.00/0.20	Copyright (C) 2011 Olivier Roussel
0.00/0.20	Using 1 processing units
0.00/0.20	This portfolio uses the following solvers:
0.00/0.20	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.20	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.20	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.20	Starting cryptominisat 2.7.1 on core(s) 5
0.00/0.20	Starting clasp 1.3.6 on core(s) 5
0.00/0.20	Starting TNM 2009 on core(s) 5

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191515-1302538124/watcher-3191515-1302538124 -o /tmp/evaluation-result-3191515-1302538124/solver-3191515-1302538124 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3191515-1302538124.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.01 10.14 8.17 9/197 15455
/proc/meminfo: memFree=15965444/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=2712 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4194304 85 0 0 0 0 0 0 0 25 0 1 0 444043115 2777088 37 33554432000 4194304 4287625 140737469913872 18446744073709551615 256410467975 0 2147483391 4096 0 18446744071699945619 0 0 17 5 0 0 0
/proc/15455/statm: 678 37 27 23 0 23 0

[startup+0.0937399 s]
/proc/loadavg: 10.01 10.14 8.17 9/197 15455
/proc/meminfo: memFree=15965444/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=2712 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4194304 85 0 0 0 0 0 0 0 25 0 1 0 444043115 2777088 37 33554432000 4194304 4287625 140737469913872 18446744073709551615 256410467975 0 2147483391 4096 0 18446744071699945619 0 0 17 5 0 0 0
/proc/15455/statm: 678 37 27 23 0 23 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2712

[startup+0.100735 s]
/proc/loadavg: 10.01 10.14 8.17 9/197 15455
/proc/meminfo: memFree=15965444/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=2712 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4194304 85 0 0 0 0 0 0 0 25 0 1 0 444043115 2777088 37 33554432000 4194304 4287625 140737469913872 18446744073709551615 256410467975 0 2147483391 4096 0 18446744071699945619 0 0 17 5 0 0 0
/proc/15455/statm: 678 37 27 23 0 23 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2712

[startup+0.3007 s]
/proc/loadavg: 10.01 10.14 8.17 9/197 15455
/proc/meminfo: memFree=15965444/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 499 0 0 0 0 0 0 0 24 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 7446724803018326280 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700627 s]
/proc/loadavg: 10.01 10.14 8.17 9/197 15455
/proc/meminfo: memFree=15965444/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 17 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611181342590238720 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50047 s]
/proc/loadavg: 10.01 10.14 8.17 12/201 15459
/proc/meminfo: memFree=15908432/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611181754907099136 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=42372 CPUtime=0.44 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 7213 0 0 0 44 0 0 0 25 0 1 0 444043134 43388928 5576 33554432000 4194304 4587354 140735896696592 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 10593 5576 326 96 0 7155 0
[pid=15458] ppid=15455 vsize=23184 CPUtime=0.34 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 4047 0 0 0 34 0 0 0 25 0 1 0 444043135 23740416 3082 33554432000 4194304 4785740 140737135709664 18446744073709551615 4304033 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 5796 3082 340 145 0 2841 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=0.5 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 50 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528273 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 543796

[startup+3.10117 s]
/proc/loadavg: 10.09 10.16 8.19 12/201 15459
/proc/meminfo: memFree=15902976/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611181754907099136 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=42372 CPUtime=0.96 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 7737 0 0 0 96 0 0 0 25 0 1 0 444043134 43388928 6098 33554432000 4194304 4587354 140735896696592 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 10593 6098 326 96 0 7155 0
[pid=15458] ppid=15455 vsize=23580 CPUtime=0.91 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 4161 0 0 0 91 0 0 0 25 0 1 0 444043135 24145920 3196 33554432000 4194304 4785740 140737135709664 18446744073709551615 4550456 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 5895 3196 340 145 0 2940 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=1 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 100 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134525871 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 2.87
Current children cumulated vsize (KiB) 544192

[startup+6.30056 s]
/proc/loadavg: 10.09 10.16 8.19 12/201 15459
/proc/meminfo: memFree=15886824/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611181892346052608 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=42552 CPUtime=2.04 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 8648 0 0 0 204 0 0 0 25 0 1 0 444043134 43573248 7002 33554432000 4194304 4587354 140735896696592 18446744073709551615 4238712 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 10638 7002 326 96 0 7200 0
[pid=15458] ppid=15455 vsize=30104 CPUtime=1.93 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 5808 0 0 0 193 0 0 0 25 0 1 0 444043135 30826496 4843 33554432000 4194304 4785740 140737135709664 18446744073709551615 4297988 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 7526 4843 340 145 0 4571 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=2.1 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 210 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134530614 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 6.07
Current children cumulated vsize (KiB) 550896

[startup+12.7004 s]
/proc/loadavg: 10.23 10.19 8.22 12/201 15460
/proc/meminfo: memFree=15836680/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611182167223959552 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=80056 CPUtime=4.16 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 10313 0 0 0 416 0 0 0 25 0 1 0 444043134 81977344 8661 33554432000 4194304 4587354 140735896696592 18446744073709551615 4250316 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 20014 8661 326 96 0 16576 0
[pid=15458] ppid=15455 vsize=42000 CPUtime=4.11 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 8783 0 0 0 410 1 0 0 25 0 1 0 444043135 43008000 7818 33554432000 4194304 4785740 140737135709664 18446744073709551615 4543541 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 10500 7818 340 145 0 7545 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=4.2 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 420 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528659 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 12.47
Current children cumulated vsize (KiB) 600296

[startup+25.5009 s]
/proc/loadavg: 10.35 10.21 8.25 12/201 15460
/proc/meminfo: memFree=15776360/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611181892346052608 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=50056 CPUtime=8.44 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 15402 0 0 0 843 1 0 0 25 0 1 0 444043134 51257344 8946 33554432000 4194304 4587354 140735896696592 18446744073709551615 256415060409 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 12514 8946 337 96 0 9076 0
[pid=15458] ppid=15455 vsize=59992 CPUtime=8.34 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 13245 0 0 0 832 2 0 0 25 0 1 0 444043135 61431808 12280 33554432000 4194304 4785740 140737135709664 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 14998 12280 340 145 0 12043 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=8.5 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 850 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 25.28
Current children cumulated vsize (KiB) 588288

[startup+51.1011 s]
/proc/loadavg: 10.57 10.27 8.32 12/201 15461
/proc/meminfo: memFree=15753096/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611180517956517888 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=51152 CPUtime=16.97 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 45165 0 0 0 1692 5 0 0 25 0 1 0 444043134 52379648 8328 33554432000 4194304 4587354 140735896696592 18446744073709551615 4238246 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 12788 8328 337 96 0 9350 0
[pid=15458] ppid=15455 vsize=80860 CPUtime=16.91 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 18472 0 0 0 1688 3 0 0 25 0 1 0 444043135 82800640 17507 33554432000 4194304 4785740 140737135709664 18446744073709551615 4551104 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 20215 17507 340 145 0 17260 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=17 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 1700 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528891 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 50.88
Current children cumulated vsize (KiB) 610252

[startup+102.307 s]
/proc/loadavg: 10.88 10.41 8.48 12/201 15492
/proc/meminfo: memFree=15743816/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611181754907099136 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=761216 CPUtime=34.04 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 67364 0 0 0 3394 10 0 0 25 0 1 0 444043134 779485184 9973 33554432000 4194304 4587354 140735896696592 18446744073709551615 4238285 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 190304 9973 337 96 0 186866 0
[pid=15458] ppid=15455 vsize=92352 CPUtime=33.96 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 21308 0 0 0 3392 4 0 0 25 0 1 0 444043135 94568448 20343 33554432000 4194304 4785740 140737135709664 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 23088 20343 340 145 0 20133 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=34.1 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 3410 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134526037 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 102.1
Current children cumulated vsize (KiB) 1331808

[startup+162.301 s]
/proc/loadavg: 10.95 10.51 8.62 12/201 15494
/proc/meminfo: memFree=15689652/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611182304662913024 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=769352 CPUtime=54.03 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 100999 0 0 0 5387 16 0 0 25 0 1 0 444043134 787816448 15037 33554432000 4194304 4587354 140735896696592 18446744073709551615 4238268 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 192338 15037 337 96 0 188900 0
[pid=15458] ppid=15455 vsize=104300 CPUtime=53.96 cores=5

################
# More data... #
################

/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 822.11
Current children cumulated vsize (KiB) 1479692

[startup+882.301 s]
/proc/loadavg: 10.00 10.05 9.35 11/200 15543
/proc/meminfo: memFree=15477876/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611182442101866496 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=780344 CPUtime=294.08 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 308157 0 0 0 29351 57 0 0 25 0 1 0 444043134 799072256 18404 33554432000 4194304 4587354 140735896696592 18446744073709551615 4230288 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 195086 18404 337 96 0 191648 0
[pid=15458] ppid=15455 vsize=220032 CPUtime=293.97 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 52634 0 0 0 29384 13 0 0 25 0 1 0 444043135 225312768 51669 33554432000 4194304 4785740 140737135709664 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 55008 51669 340 145 0 52053 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=294.06 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 29406 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528972 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 882.11
Current children cumulated vsize (KiB) 1478616

[startup+942.301 s]
/proc/loadavg: 9.96 10.02 9.38 12/201 15695
/proc/meminfo: memFree=15459928/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611181754907099136 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=841632 CPUtime=314.09 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 329671 0 0 0 31347 62 0 0 25 0 1 0 444043134 861831168 33468 33554432000 4194304 4587354 140735896696592 18446744073709551615 4388345 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 210408 33468 337 96 0 206970 0
[pid=15458] ppid=15455 vsize=220032 CPUtime=313.97 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 52671 0 0 0 31384 13 0 0 25 0 1 0 444043135 225312768 51706 33554432000 4194304 4785740 140737135709664 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 55008 51706 340 145 0 52053 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=314.06 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 31406 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 942.12
Current children cumulated vsize (KiB) 1539904

[startup+1002.3 s]
/proc/loadavg: 10.04 10.04 9.43 11/200 15757
/proc/meminfo: memFree=15507368/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=771316 CPUtime=334.09 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 338560 0 0 0 33343 66 0 0 25 0 1 0 444043134 789827584 17479 33554432000 4194304 4587354 140735896696592 18446744073709551615 4238278 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 192829 17479 337 96 0 189391 0
[pid=15458] ppid=15455 vsize=220752 CPUtime=333.97 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 52802 0 0 0 33384 13 0 0 25 0 1 0 444043135 226050048 51837 33554432000 4194304 4785740 140737135709664 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 55188 51837 340 145 0 52233 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=334.07 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 33407 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 1002.13
Current children cumulated vsize (KiB) 1470308

[startup+1062.3 s]
/proc/loadavg: 10.54 10.17 9.51 12/201 15789
/proc/meminfo: memFree=15503628/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611182442101866496 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=136192 CPUtime=354.09 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 347621 0 0 0 35339 70 0 0 25 0 1 0 444043134 139460608 19678 33554432000 4194304 4587354 140735896696592 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 34048 19678 337 96 0 30610 0
[pid=15458] ppid=15455 vsize=220752 CPUtime=353.96 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 52802 0 0 0 35383 13 0 0 25 0 1 0 444043135 226050048 51837 33554432000 4194304 4785740 140737135709664 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 55188 51837 340 145 0 52233 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=354.07 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 35407 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 835184

[startup+1122.3 s]
/proc/loadavg: 10.84 10.33 9.61 12/201 15790
/proc/meminfo: memFree=15484860/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611180380517564416 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=779852 CPUtime=374.09 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 356397 0 0 0 37336 73 0 0 25 0 1 0 444043134 798568448 21449 33554432000 4194304 4587354 140735896696592 18446744073709551615 4243671 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 194963 21449 337 96 0 191525 0
[pid=15458] ppid=15455 vsize=220752 CPUtime=373.96 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 52807 0 0 0 37383 13 0 0 25 0 1 0 444043135 226050048 51842 33554432000 4194304 4785740 140737135709664 18446744073709551615 4538896 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 55188 51842 340 145 0 52233 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=374.08 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 37408 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 1122.13
Current children cumulated vsize (KiB) 1478844

[startup+1182.3 s]
/proc/loadavg: 10.98 10.46 9.69 12/201 15792
/proc/meminfo: memFree=15439412/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611180517956517888 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=75240 CPUtime=394.08 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 365178 0 0 0 39331 77 0 0 25 0 1 0 444043134 77045760 15571 33554432000 4194304 4587354 140735896696592 18446744073709551615 4238692 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 18810 15571 337 96 0 15372 0
[pid=15458] ppid=15455 vsize=220752 CPUtime=393.96 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 52807 0 0 0 39383 13 0 0 25 0 1 0 444043135 226050048 51842 33554432000 4194304 4785740 140737135709664 18446744073709551615 4552918 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 55188 51842 340 145 0 52233 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=394.09 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 39409 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134525904 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 1182.13
Current children cumulated vsize (KiB) 774232

[startup+1242.3 s]
/proc/loadavg: 10.99 10.56 9.77 12/201 15793
/proc/meminfo: memFree=15461184/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611180792834424832 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=773888 CPUtime=414.08 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 374609 0 0 0 41327 81 0 0 25 0 1 0 444043134 792461312 16832 33554432000 4194304 4587354 140735896696592 18446744073709551615 4238332 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 193472 16832 337 96 0 190034 0
[pid=15458] ppid=15455 vsize=220752 CPUtime=413.95 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 52807 0 0 0 41382 13 0 0 25 0 1 0 444043135 226050048 51842 33554432000 4194304 4785740 140737135709664 18446744073709551615 4287042 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 55188 51842 340 145 0 52233 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=414.1 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 41410 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 1242.13
Current children cumulated vsize (KiB) 1472880



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.99 10.63 9.84 13/202 15826
/proc/meminfo: memFree=15527476/32950928 swapFree=67111524/67111528
[pid=15455] ppid=15453 vsize=18324 CPUtime=0 cores=5,7
/proc/15455/stat : 15455 (ppfolio) S 15453 15455 15219 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 444043115 18763776 394 33554432000 4194304 4287625 140737469913872 18446744073709551615 256415411727 0 0 4096 65536 4611180930273378304 0 0 17 7 0 0 0
/proc/15455/statm: 4581 394 345 23 0 91 0
[pid=15457] ppid=15455 vsize=794900 CPUtime=433.27 cores=5
/proc/15457/stat : 15457 (cryptominisat) R 15455 15455 15219 0 -1 4202496 386848 0 0 0 43244 83 0 0 25 0 1 0 444043134 813977600 21250 33554432000 4194304 4587354 140735896696592 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/15457/statm: 198725 21250 337 96 0 195287 0
[pid=15458] ppid=15455 vsize=220752 CPUtime=433.23 cores=5
/proc/15458/stat : 15458 (clasp) R 15455 15455 15219 0 -1 4202496 52818 0 0 0 43310 13 0 0 25 0 1 0 444043135 226050048 51853 33554432000 4194304 4785740 140737135709664 18446744073709551615 4278544 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/15458/statm: 55188 51853 340 145 0 52233 0
[pid=15459] ppid=15455 vsize=459916 CPUtime=433.34 cores=5
/proc/15459/stat : 15459 (TNM) R 15455 15455 15219 0 -1 4202496 3487 0 0 0 43334 0 0 0 25 0 1 0 444043135 470953984 3384 33554432000 134512640 134534564 4290887024 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/15459/statm: 114979 3384 95 6 0 113645 0
Current children cumulated CPU time (s) 1299.84
Current children cumulated vsize (KiB) 1493892

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15455 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=2999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=6998
# CPU time returned by wait4() is 0.009997
# while last known CPU time is 1299.84
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1299.84
CPU user time (s): 1298.88
CPU system time (s): 0.96
CPU usage (%): 99.9867
Max. virtual memory (cumulated for all children) (KiB): 2049052

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.002999
system time used= 0.006998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 501
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 210
involuntary context switches= 5

runsolver used 2.14067 second user time and 4.96425 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-11 18:08:44
IDJOB=3191515
IDBENCH=82646
IDSOLVER=1613
FILE ID=node115/3191515-1302538124
RUNJOBID= node115-1302536822-15240
PBS_JOBID= 12951114
Free space on /tmp= 71088 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v20000-c84000-S1298436766-097-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191515-1302538124/watcher-3191515-1302538124 -o /tmp/evaluation-result-3191515-1302538124/solver-3191515-1302538124 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3191515-1302538124.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 28b704f4b0f31dccf5e0c8fedfb14daa
RANDOM SEED=1032453651

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      15965724 kB
Buffers:        612904 kB
Cached:       15827516 kB
SwapCached:          4 kB
Active:        4561224 kB
Inactive:     12009904 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      15965724 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           32824 kB
Writeback:           0 kB
AnonPages:      130840 kB
Mapped:          16712 kB
Slab:           348876 kB
PageTables:       6068 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1678228 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71080 MiB
End job on node115 at 2011-04-11 18:30:26