Trace number 3221860

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 5000.07 4999.91

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v400-c1704-S690749326-001.UNKNOWN.cnf
MD5SUM20f33ec190b502d21efebab5417989ef
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark37.5873
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses1704
Sum of the clauses size5112
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31704
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 0
0.00/0.00	Starting TNM 2009 on core(s) 0
5000.04/4999.91	Done

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3221860-1303297525/watcher-3221860-1303297525 -o /tmp/evaluation-result-3221860-1303297525/solver-3221860-1303297525 -C 5000 -W 5000 -M 15500 ppfolio --nbcore=1 HOME/instance-3221860-1303297525.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.77 4.96 4.98 3/179 27020
/proc/meminfo: memFree=29375720/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 3867664371270254852 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0

[startup+0.088998 s]
/proc/loadavg: 4.77 4.96 4.98 3/179 27020
/proc/meminfo: memFree=29375720/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 3867664371270254852 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101009 s]
/proc/loadavg: 4.77 4.96 4.98 3/179 27020
/proc/meminfo: memFree=29375720/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 3867664371270254852 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300925 s]
/proc/loadavg: 4.77 4.96 4.98 3/179 27020
/proc/meminfo: memFree=29375720/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 17 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700898 s]
/proc/loadavg: 4.77 4.96 4.98 3/179 27020
/proc/meminfo: memFree=29375720/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948941469122560 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50063 s]
/proc/loadavg: 4.77 4.96 4.98 6/183 27024
/proc/meminfo: memFree=29372092/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332946879884820480 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=298788 CPUtime=0.49 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 1189 0 0 0 49 0 0 0 25 0 1 0 519983223 305958912 740 33554432000 4194304 4587354 140733379963296 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 74697 740 327 96 0 71259 0
[pid=27022] ppid=27020 vsize=13092 CPUtime=0.39 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 720 0 0 0 39 0 0 0 25 0 1 0 519983223 13406208 609 33554432000 4194304 4785740 140733971639600 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 3273 609 340 145 0 318 0
[pid=27023] ppid=27020 vsize=455856 CPUtime=0.59 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 321 0 0 0 59 0 0 0 25 0 1 0 519983223 466796544 218 33554432000 134512640 134534564 4288676864 18446744073709551615 134530339 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113964 218 95 6 0 112630 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 786060

[startup+3.10046 s]
/proc/loadavg: 4.87 4.97 4.99 6/183 27024
/proc/meminfo: memFree=29370108/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332947017323773952 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=299204 CPUtime=0.99 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 1610 0 0 0 99 0 0 0 25 0 1 0 519983223 306384896 903 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 74801 903 327 96 0 71363 0
[pid=27022] ppid=27020 vsize=13496 CPUtime=0.94 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 820 0 0 0 94 0 0 0 25 0 1 0 519983223 13819904 709 33554432000 4194304 4785740 140733971639600 18446744073709551615 4549079 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 3374 709 340 145 0 419 0
[pid=27023] ppid=27020 vsize=455856 CPUtime=1.14 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 321 0 0 0 114 0 0 0 25 0 1 0 519983223 466796544 218 33554432000 134512640 134534564 4288676864 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113964 218 95 6 0 112630 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 786880

[startup+6.30089 s]
/proc/loadavg: 4.87 4.97 4.99 4/179 27055
/proc/meminfo: memFree=29382520/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332947292201680896 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=305492 CPUtime=2.09 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 3667 0 0 0 209 0 0 0 25 0 1 0 519983223 312823808 2271 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238268 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 76373 2271 337 96 0 72935 0
[pid=27022] ppid=27020 vsize=13896 CPUtime=1.99 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 951 0 0 0 199 0 0 0 25 0 1 0 519983223 14229504 840 33554432000 4194304 4785740 140733971639600 18446744073709551615 4552993 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 3474 840 340 145 0 519 0
[pid=27023] ppid=27020 vsize=455856 CPUtime=2.19 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 321 0 0 0 219 0 0 0 25 0 1 0 519983223 466796544 218 33554432000 134512640 134534564 4288676864 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113964 218 95 6 0 112630 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 793568

[startup+12.7007 s]
/proc/loadavg: 5.11 5.02 5.01 7/184 27146
/proc/meminfo: memFree=29373072/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332947292201680896 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=308400 CPUtime=4.19 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 5286 0 0 0 419 0 0 0 25 0 1 0 519983223 315801600 3056 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 77100 3056 337 96 0 73662 0
[pid=27022] ppid=27020 vsize=14568 CPUtime=4.14 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 1101 0 0 0 414 0 0 0 25 0 1 0 519983223 14917632 990 33554432000 4194304 4785740 140733971639600 18446744073709551615 4552993 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 3642 990 340 145 0 687 0
[pid=27023] ppid=27020 vsize=455856 CPUtime=4.34 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 321 0 0 0 434 0 0 0 25 0 1 0 519983223 466796544 218 33554432000 134512640 134534564 4288676864 18446744073709551615 134528875 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113964 218 95 6 0 112630 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 797148

[startup+25.5003 s]
/proc/loadavg: 5.25 5.06 5.02 7/184 27146
/proc/meminfo: memFree=29363724/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332947704518541312 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=308640 CPUtime=8.49 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 7443 0 0 0 848 1 0 0 25 0 1 0 519983223 316047360 3126 33554432000 4194304 4587354 140733379963296 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 77160 3126 337 96 0 73722 0
[pid=27022] ppid=27020 vsize=15424 CPUtime=8.39 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 1311 0 0 0 839 0 0 0 25 0 1 0 519983223 15794176 1200 33554432000 4194304 4785740 140733971639600 18446744073709551615 4552983 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 3856 1200 340 145 0 901 0
[pid=27023] ppid=27020 vsize=455856 CPUtime=8.59 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 321 0 0 0 859 0 0 0 25 0 1 0 519983223 466796544 218 33554432000 134512640 134534564 4288676864 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113964 218 95 6 0 112630 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 798244

[startup+51.1007 s]
/proc/loadavg: 5.51 5.13 5.04 7/184 27147
/proc/meminfo: memFree=29356368/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332947841957494784 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=311328 CPUtime=16.99 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 11303 0 0 0 1698 1 0 0 25 0 1 0 519983223 318799872 3639 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238591 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 77832 3639 337 96 0 74394 0
[pid=27022] ppid=27020 vsize=16656 CPUtime=16.94 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 1607 0 0 0 1694 0 0 0 25 0 1 0 519983223 17055744 1496 33554432000 4194304 4785740 140733971639600 18446744073709551615 4553083 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 4164 1496 341 145 0 1209 0
[pid=27023] ppid=27020 vsize=455856 CPUtime=17.14 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 321 0 0 0 1714 0 0 0 25 0 1 0 519983223 466796544 218 33554432000 134512640 134534564 4288676864 18446744073709551615 134528926 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113964 218 95 6 0 112630 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 802164

[startup+102.306 s]
/proc/loadavg: 5.80 5.27 5.09 7/184 27148
/proc/meminfo: memFree=29346144/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332947979396448256 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=314308 CPUtime=34.08 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 17374 0 0 0 3406 2 0 0 25 0 1 0 519983223 321851392 4516 33554432000 4194304 4587354 140733379963296 18446744073709551615 4245479 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 78577 4516 337 96 0 75139 0
[pid=27022] ppid=27020 vsize=18208 CPUtime=33.98 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 2006 0 0 0 3398 0 0 0 25 0 1 0 519983223 18644992 1895 33554432000 4194304 4785740 140733971639600 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 4552 1895 341 145 0 1597 0
[pid=27023] ppid=27020 vsize=455856 CPUtime=34.21 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 321 0 0 0 3421 0 0 0 25 0 1 0 519983223 466796544 218 33554432000 134512640 134534564 4288676864 18446744073709551615 8800708 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113964 218 95 6 0 112630 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 806696

[startup+162.3 s]
/proc/loadavg: 5.92 5.40 5.15 7/184 27150
/proc/meminfo: memFree=29323892/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332947979396448256 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=325816 CPUtime=54.66 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 24473 0 0 0 5462 4 0 0 25 0 1 0 519983223 333635584 7442 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 81454 7442 337 96 0 78016 0
[pid=27022] ppid=27020 vsize=19200 CPUtime=53.68 cores=0

################
# More data... #
################

[startup+4602.3 s]
/proc/loadavg: 6.00 6.00 5.92 7/184 27400
/proc/meminfo: memFree=29179460/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=375856 CPUtime=1534.66 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 153571 0 0 0 153431 35 0 0 25 0 1 0 519983223 384876544 19489 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 93964 19489 337 96 0 90526 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1533.76 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5494 0 0 0 153375 1 0 0 25 0 1 0 519983223 34451456 5383 33554432000 4194304 4785740 140733971639600 18446744073709551615 4287076 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5383 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1534 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 153395 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 8800657 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 4602.42
Current children cumulated vsize (KiB) 883684

[startup+4662.3 s]
/proc/loadavg: 6.07 6.02 5.93 7/184 27402
/proc/meminfo: memFree=29167984/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=375856 CPUtime=1554.65 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 154842 0 0 0 155430 35 0 0 25 0 1 0 519983223 384876544 20725 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238525 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 93964 20725 337 96 0 90526 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1553.76 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5506 0 0 0 155375 1 0 0 25 0 1 0 519983223 34451456 5395 33554432000 4194304 4785740 140733971639600 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5395 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1554 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 155395 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 134528988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 4662.41
Current children cumulated vsize (KiB) 883684

[startup+4722.31 s]
/proc/loadavg: 6.02 6.01 5.93 7/184 27403
/proc/meminfo: memFree=29196444/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=367660 CPUtime=1574.67 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 155162 0 0 0 157431 36 0 0 25 0 1 0 519983223 376483840 17277 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238392 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 91915 17277 337 96 0 88477 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1573.76 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5507 0 0 0 157375 1 0 0 25 0 1 0 519983223 34451456 5396 33554432000 4194304 4785740 140733971639600 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5396 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1574 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 157395 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 134530186 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 875488

[startup+4782.3 s]
/proc/loadavg: 6.07 6.02 5.93 7/184 27405
/proc/meminfo: memFree=29190312/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=367660 CPUtime=1594.67 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 155162 0 0 0 159431 36 0 0 25 0 1 0 519983223 376483840 17277 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 91915 17277 337 96 0 88477 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1593.75 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5508 0 0 0 159374 1 0 0 25 0 1 0 519983223 34451456 5397 33554432000 4194304 4785740 140733971639600 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5397 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1594 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 159395 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 8800545 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 4782.42
Current children cumulated vsize (KiB) 875488

[startup+4842.3 s]
/proc/loadavg: 6.02 6.01 5.93 7/184 27406
/proc/meminfo: memFree=29175984/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=379628 CPUtime=1614.67 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 157015 0 0 0 161431 36 0 0 25 0 1 0 519983223 388739072 19101 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 94907 19101 337 96 0 91469 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1613.75 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5508 0 0 0 161374 1 0 0 25 0 1 0 519983223 34451456 5397 33554432000 4194304 4785740 140733971639600 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5397 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1613.99 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 161394 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 4842.41
Current children cumulated vsize (KiB) 887456

[startup+4902.3 s]
/proc/loadavg: 6.01 6.01 5.93 7/184 27408
/proc/meminfo: memFree=29184588/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=379628 CPUtime=1634.69 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 158280 0 0 0 163432 37 0 0 25 0 1 0 519983223 388739072 20305 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 94907 20305 337 96 0 91469 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1633.75 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5508 0 0 0 163374 1 0 0 25 0 1 0 519983223 34451456 5397 33554432000 4194304 4785740 140733971639600 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5397 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1633.99 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 163394 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 8707296 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 4902.43
Current children cumulated vsize (KiB) 887456

[startup+4962.3 s]
/proc/loadavg: 6.00 6.00 5.93 7/184 27410
/proc/meminfo: memFree=29195796/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=357544 CPUtime=1654.69 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 158901 0 0 0 165432 37 0 0 25 0 1 0 519983223 366125056 17309 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 89386 17309 337 96 0 85948 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1653.74 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5508 0 0 0 165373 1 0 0 25 0 1 0 519983223 34451456 5397 33554432000 4194304 4785740 140733971639600 18446744073709551615 4287042 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5397 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1653.99 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 165394 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 134529024 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 4962.42
Current children cumulated vsize (KiB) 865372



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 6.00 6.00 5.93 7/184 27411
/proc/meminfo: memFree=29189824/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=357544 CPUtime=1667.24 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 158901 0 0 0 166687 37 0 0 25 0 1 0 519983223 366125056 17309 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 89386 17309 337 96 0 85948 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1666.31 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5511 0 0 0 166630 1 0 0 25 0 1 0 519983223 34451456 5400 33554432000 4194304 4785740 140733971639600 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5400 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1666.49 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 166644 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 8799633 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 865372

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 6.00 6.00 5.93 7/184 27411
/proc/meminfo: memFree=29189824/32950928 swapFree=67071984/67111528
[pid=27020] ppid=27018 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/27020/stat : 27020 (ppfolio) S 27018 27020 26704 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 519983223 18763776 394 33554432000 4194304 4287625 140736245987264 18446744073709551615 260905414159 0 0 4096 65536 1332948804030169088 0 0 17 4 0 0 0
/proc/27020/statm: 4581 394 345 23 0 91 0
[pid=27021] ppid=27020 vsize=357544 CPUtime=1667.24 cores=0
/proc/27021/stat : 27021 (cryptominisat) R 27020 27020 26704 0 -1 4202496 158901 0 0 0 166687 37 0 0 25 0 1 0 519983223 366125056 17309 33554432000 4194304 4587354 140733379963296 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27021/statm: 89386 17309 337 96 0 85948 0
[pid=27022] ppid=27020 vsize=33644 CPUtime=1666.31 cores=0
/proc/27022/stat : 27022 (clasp) R 27020 27020 26704 0 -1 4202496 5511 0 0 0 166630 1 0 0 25 0 1 0 519983223 34451456 5400 33554432000 4194304 4785740 140733971639600 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/27022/statm: 8411 5400 341 145 0 5456 0
[pid=27023] ppid=27020 vsize=455860 CPUtime=1666.49 cores=0
/proc/27023/stat : 27023 (TNM) R 27020 27020 26704 0 -1 4202496 331 0 0 0 166644 5 0 0 25 0 1 0 519983223 466800640 228 33554432000 134512640 134534564 4288676864 18446744073709551615 8799633 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/27023/statm: 113965 228 103 6 0 112631 0
Current children cumulated CPU time (s) 5000.04
Current children cumulated vsize (KiB) 865372

Child status: 0
Real time (s): 4999.91
CPU time (s): 5000.07
CPU user time (s): 4999.62
CPU system time (s): 0.447931
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 1196612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4999.62
system time used= 0.447931
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 165277
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 231
involuntary context switches= 57343

runsolver used 8.77567 second user time and 18.3022 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-20 13:05:25
IDJOB=3221860
IDBENCH=82993
IDSOLVER=1639
FILE ID=node116/3221860-1303297525
RUNJOBID= node116-1303292522-26722
PBS_JOBID= 13049627
Free space on /tmp= 72612 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v400-c1704-S690749326-001.UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3221860-1303297525/watcher-3221860-1303297525 -o /tmp/evaluation-result-3221860-1303297525/solver-3221860-1303297525 -C 5000 -W 5000 -M 15500  ppfolio --nbcore=1 HOME/instance-3221860-1303297525.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 20f33ec190b502d21efebab5417989ef
RANDOM SEED=1988102280

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29376000 kB
Buffers:        113792 kB
Cached:        3243348 kB
SwapCached:       9616 kB
Active:         647296 kB
Inactive:      2766992 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29376000 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:           10100 kB
Writeback:           0 kB
AnonPages:       51436 kB
Mapped:          15148 kB
Slab:            97644 kB
PageTables:       4624 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   682960 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72604 MiB
End job on node116 at 2011-04-20 14:28:47