Trace number 3264989

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.18 1201.72

General information on the benchmark

NameSAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/
mod2c-rand3bip-sat-230-3.shuffled-as.sat05-2505.cnf
MD5SUMb9f02ee542f99ae0fd8f291dd570c53a
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark18.2832
Satisfiable
(Un)Satisfiability was proved
Number of variables326
Number of clauses2332
Sum of the clauses size10392
Maximum clause length6
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 41416
Number of clauses of size 5768
Number of clauses of size over 5148

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3264989-1307634659/watcher-3264989-1307634659 -o /tmp/evaluation-result-3264989-1307634659/solver-3264989-1307634659 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3264989-1307634659.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.28 10.07 7.82 6/182 20056
/proc/meminfo: memFree=31485900/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 2826088480831 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0

[startup+0.920875 s]
/proc/loadavg: 10.28 10.07 7.82 6/182 20056
/proc/meminfo: memFree=31485900/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 23 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.00086 s]
/proc/loadavg: 10.28 10.07 7.82 6/182 20056
/proc/meminfo: memFree=31485900/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) R 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.10084 s]
/proc/loadavg: 10.28 10.07 7.82 6/182 20056
/proc/meminfo: memFree=31485900/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) R 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.20083 s]
/proc/loadavg: 10.28 10.07 7.82 6/182 20056
/proc/meminfo: memFree=31485900/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) R 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50078 s]
/proc/loadavg: 10.28 10.07 7.82 6/182 20056
/proc/meminfo: memFree=31485900/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 20 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10649 s]
/proc/loadavg: 10.26 10.06 7.83 11/188 20062
/proc/meminfo: memFree=31464932/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1888084 CPUtime=3.09 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 3901 0 0 0 309 0 0 0 25 0 1 0 875066845 1933398016 2149 33554432000 4194304 4587354 140734376423776 18446744073709551615 4238435 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 472021 2149 337 96 0 468583 0
[pid=20058] ppid=20056 vsize=13904 CPUtime=3.09 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 922 0 0 0 309 0 0 0 25 0 1 0 875066845 14237696 812 33554432000 4194304 4785740 140735452494448 18446744073709551615 4286973 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 3476 812 340 145 0 521 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=2.01 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 201 0 0 0 21 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134528888 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=7748 CPUtime=3.1 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 1776 0 0 0 310 0 0 0 25 0 1 0 875066845 7933952 1137 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328051 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 1937 1137 127 39 0 1017 0
[pid=20061] ppid=20056 vsize=8200 CPUtime=1.07 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 657 0 0 0 107 0 0 0 25 0 1 0 875066845 8396800 540 33554432000 4194304 4331988 140734355344496 18446744073709551615 4263331 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 2050 540 175 34 0 492 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 2392092

[startup+6.30092 s]
/proc/loadavg: 10.26 10.06 7.83 11/188 20062
/proc/meminfo: memFree=31455144/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1889816 CPUtime=6.29 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 5533 0 0 0 629 0 0 0 25 0 1 0 875066845 1935171584 2397 33554432000 4194304 4587354 140734376423776 18446744073709551615 4357662 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 472454 2397 338 96 0 469016 0
[pid=20058] ppid=20056 vsize=14464 CPUtime=6.3 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 1077 0 0 0 630 0 0 0 25 0 1 0 875066845 14811136 967 33554432000 4194304 4785740 140735452494448 18446744073709551615 4309565 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 3616 967 340 145 0 661 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=3.61 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 361 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134528966 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=8396 CPUtime=6.3 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 2354 0 0 0 630 0 0 0 25 0 1 0 875066845 8597504 1299 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 2099 1299 127 39 0 1179 0
[pid=20061] ppid=20056 vsize=8996 CPUtime=2.65 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 832 0 0 0 265 0 0 0 25 0 1 0 875066845 9211904 706 33554432000 4194304 4331988 140734355344496 18446744073709551615 270612807180 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 2249 706 175 34 0 691 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 2395828

[startup+12.7008 s]
/proc/loadavg: 10.22 10.06 7.86 11/188 20062
/proc/meminfo: memFree=31443204/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1892328 CPUtime=12.69 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 8503 0 0 0 1268 1 0 0 25 0 1 0 875066845 1937743872 3041 33554432000 4194304 4587354 140734376423776 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 473082 3041 338 96 0 469644 0
[pid=20058] ppid=20056 vsize=15160 CPUtime=12.69 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 1238 0 0 0 1269 0 0 0 25 0 1 0 875066845 15523840 1128 33554432000 4194304 4785740 140735452494448 18446744073709551615 4550298 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 3790 1128 340 145 0 835 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=6.81 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 681 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134530980 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=9292 CPUtime=12.69 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 3122 0 0 0 1269 0 0 0 25 0 1 0 875066845 9515008 1523 33554432000 4194304 4352236 140733869479776 18446744073709551615 4329011 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 2323 1523 127 39 0 1403 0
[pid=20061] ppid=20056 vsize=10536 CPUtime=5.82 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 1167 0 0 0 582 0 0 0 25 0 1 0 875066845 10788864 1041 33554432000 4194304 4331988 140734355344496 18446744073709551615 4246862 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 2634 1041 175 34 0 1076 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 2401472

[startup+25.5005 s]
/proc/loadavg: 10.18 10.06 7.88 11/188 20062
/proc/meminfo: memFree=31412448/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1894716 CPUtime=25.49 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 14112 0 0 0 2547 2 0 0 25 0 1 0 875066845 1940189184 4020 33554432000 4194304 4587354 140734376423776 18446744073709551615 4243373 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 473679 4020 338 96 0 470241 0
[pid=20058] ppid=20056 vsize=16156 CPUtime=25.49 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 1468 0 0 0 2549 0 0 0 25 0 1 0 875066845 16543744 1358 33554432000 4194304 4785740 140735452494448 18446744073709551615 4287574 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 4039 1358 340 145 0 1084 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=13.16 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 1316 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134528710 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=12496 CPUtime=25.49 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 5203 0 0 0 2549 0 0 0 25 0 1 0 875066845 12795904 2324 33554432000 4194304 4352236 140733869479776 18446744073709551615 4276518 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 3124 2324 127 39 0 2204 0
[pid=20061] ppid=20056 vsize=13944 CPUtime=12.19 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 1822 0 0 0 1219 0 0 0 25 0 1 0 875066845 14278656 1696 33554432000 4194304 4331988 140734355344496 18446744073709551615 4291857 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 3486 1696 175 34 0 1928 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 2411468

[startup+51.101 s]
/proc/loadavg: 10.26 10.09 7.94 11/188 20107
/proc/meminfo: memFree=32050140/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1905476 CPUtime=51.09 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 24753 0 0 0 5106 3 0 0 25 0 1 0 875066845 1951207424 6298 33554432000 4194304 4587354 140734376423776 18446744073709551615 4238392 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 476369 6298 338 96 0 472931 0
[pid=20058] ppid=20056 vsize=17448 CPUtime=51.09 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 1780 0 0 0 5109 0 0 0 25 0 1 0 875066845 17866752 1670 33554432000 4194304 4785740 140735452494448 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 4362 1670 341 145 0 1407 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=25.9 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 2590 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134530664 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=14416 CPUtime=51.08 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 7795 0 0 0 5108 0 0 0 25 0 1 0 875066845 14761984 2804 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328105 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 3604 2804 127 39 0 2684 0
[pid=20061] ppid=20056 vsize=21476 CPUtime=24.9 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 3101 0 0 0 2490 0 0 0 25 0 1 0 875066845 21991424 2975 33554432000 4194304 4331988 140734355344496 18446744073709551615 4287456 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 5369 2975 175 34 0 3811 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 2432972

[startup+102.301 s]
/proc/loadavg: 10.19 10.10 8.07 11/188 20115
/proc/meminfo: memFree=31990740/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1901336 CPUtime=102.15 cores=1

################
# More data... #
################

/proc/20061/statm: 60158 44339 175 34 0 58600 0
Current children cumulated CPU time (s) 3524.26
Current children cumulated vsize (KiB) 2702804

[startup+942.301 s]
/proc/loadavg: 10.26 10.23 9.33 11/188 20150
/proc/meminfo: memFree=31462608/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1953052 CPUtime=942.15 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 167761 0 0 0 94180 35 0 0 25 0 1 0 875066845 1999925248 17487 33554432000 4194304 4587354 140734376423776 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 488263 17487 338 96 0 484825 0
[pid=20058] ppid=20056 vsize=29192 CPUtime=942.31 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 4445 0 0 0 94231 0 0 0 25 0 1 0 875066845 29892608 4335 33554432000 4194304 4785740 140735452494448 18446744073709551615 4278145 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 7298 4335 341 145 0 4343 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=469.05 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 46905 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 10532283 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=34396 CPUtime=942.31 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 52918 0 0 0 94224 7 0 0 25 0 1 0 875066845 35221504 7799 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 8599 7799 127 39 0 7679 0
[pid=20061] ppid=20056 vsize=274656 CPUtime=468.12 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 47373 0 0 0 46796 16 0 0 25 0 1 0 875066845 281247744 47247 33554432000 4194304 4331988 140734355344496 18446744073709551615 4316666 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 68664 47247 175 34 0 67106 0
Current children cumulated CPU time (s) 3763.94
Current children cumulated vsize (KiB) 2765452

[startup+1002.3 s]
/proc/loadavg: 10.29 10.24 9.39 11/188 20151
/proc/meminfo: memFree=31425120/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1952880 CPUtime=1002.15 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 172388 0 0 0 100180 35 0 0 25 0 1 0 875066845 1999749120 18710 33554432000 4194304 4587354 140734376423776 18446744073709551615 4238392 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 488220 18710 338 96 0 484782 0
[pid=20058] ppid=20056 vsize=29700 CPUtime=1002.31 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 4527 0 0 0 100231 0 0 0 25 0 1 0 875066845 30412800 4417 33554432000 4194304 4785740 140735452494448 18446744073709551615 4278129 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 7425 4417 341 145 0 4470 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=498.92 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 49892 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134528991 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=32092 CPUtime=1002.31 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 54134 0 0 0 100224 7 0 0 25 0 1 0 875066845 32862208 7223 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 8023 7223 127 39 0 7103 0
[pid=20061] ppid=20056 vsize=274656 CPUtime=497.92 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 50319 0 0 0 49775 17 0 0 25 0 1 0 875066845 281247744 50193 33554432000 4194304 4331988 140734355344496 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 68664 50193 175 34 0 67106 0
Current children cumulated CPU time (s) 4003.61
Current children cumulated vsize (KiB) 2763484

[startup+1062.3 s]
/proc/loadavg: 10.35 10.26 9.45 11/188 20153
/proc/meminfo: memFree=31424092/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1936764 CPUtime=1062.16 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 176483 0 0 0 106179 37 0 0 25 0 1 0 875066845 1983246336 15914 33554432000 4194304 4587354 140734376423776 18446744073709551615 4244336 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 484191 15914 338 96 0 480753 0
[pid=20058] ppid=20056 vsize=29868 CPUtime=1062.31 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 4573 0 0 0 106231 0 0 0 25 0 1 0 875066845 30584832 4463 33554432000 4194304 4785740 140735452494448 18446744073709551615 4287092 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 7467 4463 341 145 0 4512 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=528.73 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 52873 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=35420 CPUtime=1062.32 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 55862 0 0 0 106225 7 0 0 25 0 1 0 875066845 36270080 8055 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 8855 8055 127 39 0 7935 0
[pid=20061] ppid=20056 vsize=274656 CPUtime=527.79 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 53355 0 0 0 52761 18 0 0 25 0 1 0 875066845 281247744 53229 33554432000 4194304 4331988 140734355344496 18446744073709551615 4210516 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 68664 53229 175 34 0 67106 0
Current children cumulated CPU time (s) 4243.31
Current children cumulated vsize (KiB) 2750864

[startup+1122.3 s]
/proc/loadavg: 10.26 10.24 9.49 11/188 20155
/proc/meminfo: memFree=31389832/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1951168 CPUtime=1122.15 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 180011 0 0 0 112178 37 0 0 25 0 1 0 875066845 1997996032 15914 33554432000 4194304 4587354 140734376423776 18446744073709551615 4238770 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 487792 15914 338 96 0 484354 0
[pid=20058] ppid=20056 vsize=30036 CPUtime=1122.31 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 4623 0 0 0 112231 0 0 0 25 0 1 0 875066845 30756864 4513 33554432000 4194304 4785740 140735452494448 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 7509 4513 341 145 0 4554 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=558.58 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 55858 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134530693 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=31836 CPUtime=1122.31 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 56758 0 0 0 112224 7 0 0 25 0 1 0 875066845 32600064 7159 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328068 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 7959 7159 127 39 0 7039 0
[pid=20061] ppid=20056 vsize=274656 CPUtime=557.61 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 56203 0 0 0 55742 19 0 0 25 0 1 0 875066845 281247744 56077 33554432000 4194304 4331988 140734355344496 18446744073709551615 4239530 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 68664 56077 175 34 0 67106 0
Current children cumulated CPU time (s) 4482.96
Current children cumulated vsize (KiB) 2761852

[startup+1182.31 s]
/proc/loadavg: 10.21 10.23 9.53 11/188 20156
/proc/meminfo: memFree=31343800/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1940720 CPUtime=1182.16 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 183579 0 0 0 118177 39 0 0 25 0 1 0 875066845 1987297280 15914 33554432000 4194304 4587354 140734376423776 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 485180 15914 338 96 0 481742 0
[pid=20058] ppid=20056 vsize=30204 CPUtime=1182.32 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 4659 0 0 0 118232 0 0 0 25 0 1 0 875066845 30928896 4549 33554432000 4194304 4785740 140735452494448 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 7551 4549 341 145 0 4596 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=588.42 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 58842 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=34140 CPUtime=1182.33 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 58230 0 0 0 118225 8 0 0 25 0 1 0 875066845 34959360 7735 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328116 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 8535 7735 127 39 0 7615 0
[pid=20061] ppid=20056 vsize=274656 CPUtime=587.45 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 59163 0 0 0 58725 20 0 0 25 0 1 0 875066845 281247744 59037 33554432000 4194304 4331988 140734355344496 18446744073709551615 4308792 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 68664 59037 175 34 0 67106 0
Current children cumulated CPU time (s) 4722.68
Current children cumulated vsize (KiB) 2753876



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.23 10.23 9.55 11/188 20157
/proc/meminfo: memFree=31354948/32951124 swapFree=67052292/67111528
[pid=20056] ppid=20054 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20056/stat : 20056 (ppfolio) S 20054 20056 19795 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 875066844 18763776 389 33554432000 4194304 4287625 140734169013152 18446744073709551615 270613130767 0 0 4096 65536 7646118075619606527 0 0 17 1 0 0 0
/proc/20056/statm: 4581 389 341 23 0 91 0
[pid=20057] ppid=20056 vsize=1940720 CPUtime=1201.57 cores=1
/proc/20057/stat : 20057 (cryptominisat) R 20056 20056 19795 0 -1 4202496 183579 0 0 0 120118 39 0 0 25 0 1 0 875066845 1987297280 15914 33554432000 4194304 4587354 140734376423776 18446744073709551615 4232133 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20057/statm: 485180 15914 338 96 0 481742 0
[pid=20058] ppid=20056 vsize=30204 CPUtime=1201.72 cores=5
/proc/20058/stat : 20058 (clasp) R 20056 20056 19795 0 -1 4202496 4662 0 0 0 120172 0 0 0 25 0 1 0 875066845 30928896 4552 33554432000 4194304 4785740 140735452494448 18446744073709551615 4562640 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20058/statm: 7551 4552 341 145 0 4596 0
[pid=20059] ppid=20056 vsize=455832 CPUtime=598.06 cores=7
/proc/20059/stat : 20059 (TNM) R 20056 20056 19795 0 -1 4202496 338 0 0 0 59806 0 0 0 25 0 1 0 875066845 466771968 235 33554432000 134512640 134534564 4294813376 18446744073709551615 134529632 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20059/statm: 113958 235 95 6 0 112624 0
[pid=20060] ppid=20056 vsize=31580 CPUtime=1201.73 cores=3
/proc/20060/stat : 20060 (lingeling) R 20056 20056 19795 0 -1 4202496 58422 0 0 0 120165 8 0 0 25 0 1 0 875066845 32337920 7095 33554432000 4194304 4352236 140733869479776 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20060/statm: 7895 7095 127 39 0 6975 0
[pid=20061] ppid=20056 vsize=274656 CPUtime=597.1 cores=7
/proc/20061/stat : 20061 (march_hi) R 20056 20056 19795 0 -1 4202496 60107 0 0 0 59690 20 0 0 25 0 1 0 875066845 281247744 59981 33554432000 4194304 4331988 140734355344496 18446744073709551615 4228335 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20061/statm: 68664 59981 175 34 0 67106 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 2751316

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20056 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=4999
# CPU time returned by wait4() is 0.006998
# while last known CPU time is 4800.18
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.72
CPU time (s): 4800.18
CPU user time (s): 4799.51
CPU system time (s): 0.67
CPU usage (%): 399.442
Max. virtual memory (cumulated for all children) (KiB): 4638976

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.004999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 520
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 411
involuntary context switches= 6

runsolver used 1.91871 second user time and 4.64329 second system time

The end

Launcher Data 

Begin job on node108 at 2011-06-09 17:50:59
IDJOB=3264989
IDBENCH=85366
IDSOLVER=1612
FILE ID=node108/3264989-1307634659
RUNJOBID= node108-1307633278-19814
PBS_JOBID= 13549383
Free space on /tmp= 74072 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/mod2c-rand3bip-sat-230-3.shuffled-as.sat05-2505.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3264989-1307634659/watcher-3264989-1307634659 -o /tmp/evaluation-result-3264989-1307634659/solver-3264989-1307634659 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3264989-1307634659.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b9f02ee542f99ae0fd8f291dd570c53a
RANDOM SEED=1715957042

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31486328 kB
Buffers:        210852 kB
Cached:         357708 kB
SwapCached:      25900 kB
Active:        1008416 kB
Inactive:       243708 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31486328 kB
SwapTotal:    67111528 kB
SwapFree:     67052292 kB
Dirty:           10108 kB
Writeback:           0 kB
AnonPages:      678648 kB
Mapped:          11140 kB
Slab:           147308 kB
PageTables:       6412 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1385916 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74064 MiB
End job on node108 at 2011-06-09 18:11:03