Trace number 3191194

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.15 1201.62

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v600-c2556-S1677156340-036.UNKNOWN.cnf
MD5SUM99f3efd3bfc8a6f99ffbd289ed4a5837
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses2556
Sum of the clauses size7668
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32556
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191194-1304065082/watcher-3191194-1304065082 -o /tmp/evaluation-result-3191194-1304065082/solver-3191194-1304065082 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191194-1304065082.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.76 5.28 6.74 1/171 25197
/proc/meminfo: memFree=17465716/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) R 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0

[startup+0.430666 s]
/proc/loadavg: 4.76 5.28 6.74 1/171 25197
/proc/meminfo: memFree=17465716/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 24 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.500655 s]
/proc/loadavg: 4.76 5.28 6.74 1/171 25197
/proc/meminfo: memFree=17465716/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.600636 s]
/proc/loadavg: 4.76 5.28 6.74 1/171 25197
/proc/meminfo: memFree=17465716/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 21 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700619 s]
/proc/loadavg: 4.76 5.28 6.74 1/171 25197
/proc/meminfo: memFree=17465716/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 20 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50648 s]
/proc/loadavg: 4.76 5.28 6.74 6/177 25203
/proc/meminfo: memFree=17455004/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1437288 CPUtime=1.49 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 3963 0 0 0 149 0 0 0 25 0 1 0 596738947 1471782912 2631 33554432000 4194304 4587354 140736460151488 18446744073709551615 4365356 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 359322 2631 337 96 0 355884 0
[pid=25199] ppid=25197 vsize=14292 CPUtime=1.5 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 1022 0 0 0 150 0 0 0 25 0 1 0 596738947 14635008 908 33554432000 4194304 4785740 140733387331344 18446744073709551615 4549576 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 3573 908 340 145 0 618 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=0.7 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 70 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=6588 CPUtime=1.5 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 1238 0 0 0 150 0 0 0 20 0 1 0 596738947 6746112 846 33554432000 4194304 4352236 140735903863504 18446744073709551615 4328475 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 1647 846 127 39 0 727 0
[pid=25202] ppid=25197 vsize=7992 CPUtime=0.79 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 619 0 0 0 79 0 0 0 25 0 1 0 596738947 8183808 511 33554432000 4194304 4331988 140737421646416 18446744073709551615 4229616 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 1998 511 172 34 0 440 0
Current children cumulated CPU time (s) 5.98
Current children cumulated vsize (KiB) 1940440

[startup+3.10126 s]
/proc/loadavg: 4.76 5.28 6.74 6/177 25203
/proc/meminfo: memFree=17447068/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1438608 CPUtime=3.09 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 5434 0 0 0 309 0 0 0 25 0 1 0 596738947 1473134592 3156 33554432000 4194304 4587354 140736460151488 18446744073709551615 4356836 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 359652 3156 337 96 0 356214 0
[pid=25199] ppid=25197 vsize=15100 CPUtime=3.09 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 1244 0 0 0 309 0 0 0 25 0 1 0 596738947 15462400 1130 33554432000 4194304 4785740 140733387331344 18446744073709551615 4553429 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 3775 1130 340 145 0 820 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=1.5 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 150 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=6460 CPUtime=3.09 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 1270 0 0 0 309 0 0 0 25 0 1 0 596738947 6615040 814 33554432000 4194304 4352236 140735903863504 18446744073709551615 4328847 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 1615 814 127 39 0 695 0
[pid=25202] ppid=25197 vsize=8296 CPUtime=1.58 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 686 0 0 0 158 0 0 0 25 0 1 0 596738947 8495104 578 33554432000 4194304 4331988 140737421646416 18446744073709551615 4229292 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 2074 578 173 34 0 516 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 1942744

[startup+6.3007 s]
/proc/loadavg: 4.86 5.29 6.74 6/177 25203
/proc/meminfo: memFree=17439980/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1442032 CPUtime=6.29 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 8040 0 0 0 628 1 0 0 25 0 1 0 596738947 1476640768 3985 33554432000 4194304 4587354 140736460151488 18446744073709551615 4236455 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 360508 3985 337 96 0 357070 0
[pid=25199] ppid=25197 vsize=16316 CPUtime=6.29 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 1557 0 0 0 629 0 0 0 25 0 1 0 596738947 16707584 1443 33554432000 4194304 4785740 140733387331344 18446744073709551615 4553784 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 4079 1443 340 145 0 1124 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=3.1 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 310 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134529775 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=6980 CPUtime=6.29 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 2073 0 0 0 629 0 0 0 25 0 1 0 596738947 7147520 944 33554432000 4194304 4352236 140735903863504 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 1745 944 127 39 0 825 0
[pid=25202] ppid=25197 vsize=8676 CPUtime=3.16 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 745 0 0 0 316 0 0 0 25 0 1 0 596738947 8884224 637 33554432000 4194304 4331988 140737421646416 18446744073709551615 4229310 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 2169 637 173 34 0 611 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 1948284

[startup+12.7006 s]
/proc/loadavg: 4.87 5.29 6.73 6/177 25203
/proc/meminfo: memFree=17431416/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1468720 CPUtime=12.69 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 10034 0 0 0 1268 1 0 0 25 0 1 0 596738947 1503969280 5245 33554432000 4194304 4587354 140736460151488 18446744073709551615 4231420 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 367180 5245 337 96 0 363742 0
[pid=25199] ppid=25197 vsize=17820 CPUtime=12.69 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 1914 0 0 0 1269 0 0 0 25 0 1 0 596738947 18247680 1800 33554432000 4194304 4785740 140733387331344 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 4455 1800 340 145 0 1500 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=6.3 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 630 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=8260 CPUtime=12.69 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 3193 0 0 0 1269 0 0 0 25 0 1 0 596738947 8458240 1264 33554432000 4194304 4352236 140735903863504 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 2065 1264 127 39 0 1145 0
[pid=25202] ppid=25197 vsize=9152 CPUtime=6.33 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 887 0 0 0 633 0 0 0 25 0 1 0 596738947 9371648 779 33554432000 4194304 4331988 140737421646416 18446744073709551615 4240548 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 2288 779 173 34 0 730 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 1978232

[startup+25.5003 s]
/proc/loadavg: 4.89 5.28 6.71 6/177 25204
/proc/meminfo: memFree=17426316/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1447880 CPUtime=25.49 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 13541 0 0 0 2547 2 0 0 25 0 1 0 596738947 1482629120 5284 33554432000 4194304 4587354 140736460151488 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 361970 5284 337 96 0 358532 0
[pid=25199] ppid=25197 vsize=19744 CPUtime=25.49 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 2368 0 0 0 2549 0 0 0 25 0 1 0 596738947 20217856 2254 33554432000 4194304 4785740 140733387331344 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 4936 2254 340 145 0 1981 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=12.65 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 1265 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=10952 CPUtime=25.49 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 5978 0 0 0 2548 1 0 0 25 0 1 0 596738947 11214848 1937 33554432000 4194304 4352236 140735903863504 18446744073709551615 4328872 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 2738 1937 127 39 0 1818 0
[pid=25202] ppid=25197 vsize=10828 CPUtime=12.72 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 1129 0 0 0 1272 0 0 0 25 0 1 0 596738947 11087872 1021 33554432000 4194304 4331988 140737421646416 18446744073709551615 4229533 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 2707 1021 173 34 0 1149 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 1963684

[startup+51.1009 s]
/proc/loadavg: 5.00 5.26 6.66 6/177 25204
/proc/meminfo: memFree=17398844/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=57064 CPUtime=51.09 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 20995 0 0 0 5105 4 0 0 25 0 1 0 596738947 58433536 10529 33554432000 4194304 4587354 140736460151488 18446744073709551615 4238618 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 14266 10529 337 96 0 10828 0
[pid=25199] ppid=25197 vsize=22760 CPUtime=51.09 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 3097 0 0 0 5109 0 0 0 25 0 1 0 596738947 23306240 2983 33554432000 4194304 4785740 140733387331344 18446744073709551615 4416773 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 5690 2983 340 145 0 2735 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=25.39 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 2539 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134530573 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=11980 CPUtime=51.08 cores=2

################
# More data... #
################

/proc/25202/statm: 21099 15483 173 34 0 19541 0
Current children cumulated CPU time (s) 3524.57
Current children cumulated vsize (KiB) 2132752

[startup+942.301 s]
/proc/loadavg: 5.12 5.11 5.68 6/177 25228
/proc/meminfo: memFree=17259392/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1500372 CPUtime=942.31 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 112591 0 0 0 94190 41 0 0 25 0 1 0 596738947 1536380928 19651 33554432000 4194304 4587354 140736460151488 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 375093 19651 337 96 0 371655 0
[pid=25199] ppid=25197 vsize=46652 CPUtime=942.31 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 8646 0 0 0 94230 1 0 0 25 0 1 0 596738947 47771648 8532 33554432000 4194304 4785740 140733387331344 18446744073709551615 4550931 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 11663 8532 341 145 0 8708 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=468.62 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 46862 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=32976 CPUtime=942.31 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 80188 0 0 0 94219 12 0 0 25 0 1 0 596738947 33767424 7443 33554432000 4194304 4352236 140735903863504 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 8244 7443 127 39 0 7324 0
[pid=25202] ppid=25197 vsize=84396 CPUtime=468.74 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 16555 0 0 0 46866 8 0 0 25 0 1 0 596738947 86421504 16447 33554432000 4194304 4331988 140737421646416 18446744073709551615 4229527 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 21099 16447 173 34 0 19541 0
Current children cumulated CPU time (s) 3764.29
Current children cumulated vsize (KiB) 2138676

[startup+1002.3 s]
/proc/loadavg: 5.12 5.10 5.63 6/177 25230
/proc/meminfo: memFree=17258628/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1499204 CPUtime=1002.31 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 116145 0 0 0 100189 42 0 0 25 0 1 0 596738947 1535184896 19111 33554432000 4194304 4587354 140736460151488 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 374801 19111 337 96 0 371363 0
[pid=25199] ppid=25197 vsize=47268 CPUtime=1002.31 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 8763 0 0 0 100230 1 0 0 25 0 1 0 596738947 48402432 8649 33554432000 4194304 4785740 140733387331344 18446744073709551615 4553187 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 11817 8649 341 145 0 8862 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=498.5 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 49850 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134530468 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=31316 CPUtime=1002.31 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 84573 0 0 0 100218 13 0 0 25 0 1 0 596738947 32067584 7028 33554432000 4194304 4352236 140735903863504 18446744073709551615 4329205 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 7829 7028 127 39 0 6909 0
[pid=25202] ppid=25197 vsize=84396 CPUtime=498.54 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 17496 0 0 0 49846 8 0 0 25 0 1 0 596738947 86421504 17388 33554432000 4194304 4331988 140737421646416 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 21099 17388 173 34 0 19541 0
Current children cumulated CPU time (s) 4003.97
Current children cumulated vsize (KiB) 2136464

[startup+1062.3 s]
/proc/loadavg: 5.12 5.10 5.60 6/177 25231
/proc/meminfo: memFree=17256484/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1498888 CPUtime=1062.32 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 123235 0 0 0 106187 45 0 0 25 0 1 0 596738947 1534861312 18284 33554432000 4194304 4587354 140736460151488 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 374722 18284 337 96 0 371284 0
[pid=25199] ppid=25197 vsize=48560 CPUtime=1062.31 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 9046 0 0 0 106230 1 0 0 25 0 1 0 596738947 49725440 8932 33554432000 4194304 4785740 140733387331344 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 12140 8932 341 145 0 9185 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=528.31 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 52831 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134529651 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=32340 CPUtime=1062.31 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 86205 0 0 0 106218 13 0 0 25 0 1 0 596738947 33116160 7284 33554432000 4194304 4352236 140735903863504 18446744073709551615 4328351 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 8085 7284 127 39 0 7165 0
[pid=25202] ppid=25197 vsize=84396 CPUtime=528.42 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 18389 0 0 0 52833 9 0 0 25 0 1 0 596738947 86421504 18281 33554432000 4194304 4331988 140737421646416 18446744073709551615 4229623 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 21099 18281 173 34 0 19541 0
Current children cumulated CPU time (s) 4243.67
Current children cumulated vsize (KiB) 2138464

[startup+1122.3 s]
/proc/loadavg: 5.10 5.09 5.56 6/177 25233
/proc/meminfo: memFree=17240472/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1499324 CPUtime=1122.32 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 129083 0 0 0 112185 47 0 0 25 0 1 0 596738947 1535307776 20014 33554432000 4194304 4587354 140736460151488 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 374831 20014 337 96 0 371393 0
[pid=25199] ppid=25197 vsize=49096 CPUtime=1122.32 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 9162 0 0 0 112231 1 0 0 25 0 1 0 596738947 50274304 9048 33554432000 4194304 4785740 140733387331344 18446744073709551615 4287158 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 12274 9048 341 145 0 9319 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=558.18 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 55818 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134529816 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=36820 CPUtime=1122.31 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 90749 0 0 0 112218 13 0 0 25 0 1 0 596738947 37703680 8404 33554432000 4194304 4352236 140735903863504 18446744073709551615 4329149 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 9205 8404 127 39 0 8285 0
[pid=25202] ppid=25197 vsize=113996 CPUtime=558.23 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 19381 0 0 0 55814 9 0 0 25 0 1 0 596738947 116731904 19273 33554432000 4194304 4331988 140737421646416 18446744073709551615 4292808 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 28499 19273 173 34 0 26941 0
Current children cumulated CPU time (s) 4483.36
Current children cumulated vsize (KiB) 2173516

[startup+1182.3 s]
/proc/loadavg: 5.10 5.09 5.53 6/177 25234
/proc/meminfo: memFree=17229036/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1515068 CPUtime=1182.32 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 140285 0 0 0 118180 52 0 0 25 0 1 0 596738947 1551429632 23024 33554432000 4194304 4587354 140736460151488 18446744073709551615 4357662 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 378767 23024 337 96 0 375329 0
[pid=25199] ppid=25197 vsize=49556 CPUtime=1182.31 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 9278 0 0 0 118230 1 0 0 25 0 1 0 596738947 50745344 9164 33554432000 4194304 4785740 140733387331344 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 12389 9164 341 145 0 9434 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=588 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 58800 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=31316 CPUtime=1182.31 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 92125 0 0 0 118217 14 0 0 25 0 1 0 596738947 32067584 7028 33554432000 4194304 4352236 140735903863504 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 7829 7028 127 39 0 6909 0
[pid=25202] ppid=25197 vsize=113996 CPUtime=588.1 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 20378 0 0 0 58800 10 0 0 25 0 1 0 596738947 116731904 20270 33554432000 4194304 4331988 140737421646416 18446744073709551615 4226438 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 28499 20270 173 34 0 26941 0
Current children cumulated CPU time (s) 4723.04
Current children cumulated vsize (KiB) 2184216



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.61 s]
/proc/loadavg: 5.07 5.08 5.52 6/177 25235
/proc/meminfo: memFree=17213040/32950940 swapFree=67111528/67111528
[pid=25197] ppid=25195 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25197/stat : 25197 (ppfolio) S 25195 25197 21582 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 596738947 18763776 390 33554432000 4194304 4287625 140734215226736 18446744073709551615 215988612623 0 0 4096 65536 8774490921552052223 0 0 17 4 0 0 0
/proc/25197/statm: 4581 390 341 23 0 91 0
[pid=25198] ppid=25197 vsize=1523220 CPUtime=1201.62 cores=0
/proc/25198/stat : 25198 (cryptominisat) R 25197 25197 21582 0 -1 4202496 143009 0 0 0 120110 52 0 0 25 0 1 0 596738947 1559777280 25722 33554432000 4194304 4587354 140736460151488 18446744073709551615 4238668 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25198/statm: 380805 25722 337 96 0 377367 0
[pid=25199] ppid=25197 vsize=49556 CPUtime=1201.62 cores=4
/proc/25199/stat : 25199 (clasp) R 25197 25197 21582 0 -1 4202496 9281 0 0 0 120161 1 0 0 25 0 1 0 596738947 50745344 9167 33554432000 4194304 4785740 140733387331344 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25199/statm: 12389 9167 341 145 0 9434 0
[pid=25200] ppid=25197 vsize=455956 CPUtime=597.6 cores=6
/proc/25200/stat : 25200 (TNM) R 25197 25197 21582 0 -1 4202496 356 0 0 0 59760 0 0 0 25 0 1 0 596738947 466898944 252 33554432000 134512640 134534564 4290392384 18446744073709551615 134528310 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25200/statm: 113989 252 95 6 0 112655 0
[pid=25201] ppid=25197 vsize=35668 CPUtime=1201.62 cores=2
/proc/25201/stat : 25201 (lingeling) R 25197 25197 21582 0 -1 4202496 93213 0 0 0 120148 14 0 0 25 0 1 0 596738947 36524032 8116 33554432000 4194304 4352236 140735903863504 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25201/statm: 8917 8116 127 39 0 7997 0
[pid=25202] ppid=25197 vsize=113996 CPUtime=597.69 cores=6
/proc/25202/stat : 25202 (march_hi) R 25197 25197 21582 0 -1 4202496 20696 0 0 0 59759 10 0 0 25 0 1 0 596738947 116731904 20588 33554432000 4194304 4331988 140737421646416 18446744073709551615 4284253 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25202/statm: 28499 20588 173 34 0 26941 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 2196720

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25197 and gives
#  childrusage.ru_utime.tv_sec=2403
#  childrusage.ru_utime.tv_usec=108671
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=167974
# CPU time returned by wait4() is 2403.28
# while last known CPU time is 4800.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.62
CPU time (s): 4800.15
CPU user time (s): 4799.38
CPU system time (s): 0.77
CPU usage (%): 399.474
Max. virtual memory (cumulated for all children) (KiB): 3466444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2403.11
system time used= 0.167974
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 103034
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 481
involuntary context switches= 4023

runsolver used 2.04869 second user time and 4.28135 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-29 10:18:02
IDJOB=3191194
IDBENCH=82925
IDSOLVER=1612
FILE ID=node117/3191194-1304065082
RUNJOBID= node117-1304062554-24496
PBS_JOBID= 13170383
Free space on /tmp= 71680 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v600-c2556-S1677156340-036.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191194-1304065082/watcher-3191194-1304065082 -o /tmp/evaluation-result-3191194-1304065082/solver-3191194-1304065082 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191194-1304065082.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 99f3efd3bfc8a6f99ffbd289ed4a5837
RANDOM SEED=345345715

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      17465880 kB
Buffers:       2378280 kB
Cached:       12462356 kB
SwapCached:          0 kB
Active:        8110536 kB
Inactive:      6794196 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      17465880 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            9952 kB
Writeback:           0 kB
AnonPages:       63376 kB
Mapped:          14776 kB
Slab:           517900 kB
PageTables:       4160 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   189820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71672 MiB
End job on node117 at 2011-04-29 10:38:05