Trace number 3289720

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.16 1201.71

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom17.cnf
MD5SUMa6df2ce216327c64a0156683acb72fc2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables32733
Number of clauses109177
Sum of the clauses size278009
Maximum clause length1080
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 256533
Number of clauses of size 352066
Number of clauses of size 4152
Number of clauses of size 515
Number of clauses of size over 5410

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289720-1304081893/watcher-3289720-1304081893 -o /tmp/evaluation-result-3289720-1304081893/solver-3289720-1304081893 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3289720-1304081893.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.27 9.09 8.98 5/185 1393
/proc/meminfo: memFree=30495292/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 519787154 18763776 389 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 2826088480831 0 0 17 4 0 0 0
/proc/1393/statm: 4581 389 341 23 0 91 0

[startup+0.134847 s]
/proc/loadavg: 9.27 9.09 8.98 5/185 1393
/proc/meminfo: memFree=30495292/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 25 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.200836 s]
/proc/loadavg: 9.27 9.09 8.98 5/185 1393
/proc/meminfo: memFree=30495292/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 25 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.300819 s]
/proc/loadavg: 9.27 9.09 8.98 5/185 1393
/proc/meminfo: memFree=30495292/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 25 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.700746 s]
/proc/loadavg: 9.27 9.09 8.98 5/185 1393
/proc/meminfo: memFree=30495292/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 25 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+1.5006 s]
/proc/loadavg: 9.27 9.09 8.98 9/190 1399
/proc/meminfo: memFree=30406220/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=54808 CPUtime=1.49 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 9906 0 0 0 148 1 0 0 20 0 1 0 519787155 56123392 8609 33554432000 4194304 4587354 140736423504880 18446744073709551615 4242538 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 13702 8609 330 96 0 10264 0
[pid=1395] ppid=1393 vsize=31364 CPUtime=1.49 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 6594 0 0 0 148 1 0 0 25 0 1 0 519787155 32116736 5136 33554432000 4194304 4785740 140733745071856 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 7841 5136 340 145 0 4886 0
[pid=1397] ppid=1393 vsize=14528 CPUtime=1.49 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 3935 0 0 0 149 0 0 0 25 0 1 0 519787155 14876672 2798 33554432000 4194304 4352236 140737343332272 18446744073709551615 4297710 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 3632 2798 125 39 0 2712 0
[pid=1398] ppid=1393 vsize=76744 CPUtime=1.46 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 39523 0 0 0 142 4 0 0 25 0 1 0 519787155 78585856 9426 33554432000 4194304 4331988 140734343368928 18446744073709551615 271549932686 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 19186 9426 175 34 0 17628 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 195768

[startup+3.10031 s]
/proc/loadavg: 9.27 9.09 8.98 9/190 1399
/proc/meminfo: memFree=30384148/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=55076 CPUtime=3.09 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 10476 0 0 0 308 1 0 0 25 0 1 0 519787155 56397824 9168 33554432000 4194304 4587354 140736423504880 18446744073709551615 4238622 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 13769 9168 330 96 0 10331 0
[pid=1395] ppid=1393 vsize=34672 CPUtime=3.09 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 7414 0 0 0 308 1 0 0 25 0 1 0 519787155 35504128 5956 33554432000 4194304 4785740 140733745071856 18446744073709551615 4553022 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 8668 5956 340 145 0 5713 0
[pid=1397] ppid=1393 vsize=12404 CPUtime=3.08 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 3937 0 0 0 308 0 0 0 25 0 1 0 519787155 12701696 2269 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328059 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 3101 2269 127 39 0 2181 0
[pid=1398] ppid=1393 vsize=80460 CPUtime=3.06 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 40513 0 0 0 301 5 0 0 25 0 1 0 519787155 82391040 10416 33554432000 4194304 4331988 140734343368928 18446744073709551615 4243021 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 20115 10416 175 34 0 18557 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 200936

[startup+6.30073 s]
/proc/loadavg: 9.17 9.08 8.97 9/190 1399
/proc/meminfo: memFree=30372620/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=482340 CPUtime=6.28 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 12581 0 0 0 627 1 0 0 25 0 1 0 519787155 493916160 9191 33554432000 4194304 4587354 140736423504880 18446744073709551615 4451380 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 120585 9191 336 96 0 117147 0
[pid=1395] ppid=1393 vsize=38564 CPUtime=6.29 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 8401 0 0 0 627 2 0 0 25 0 1 0 519787155 39489536 6943 33554432000 4194304 4785740 140733745071856 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 9641 6943 340 145 0 6686 0
[pid=1397] ppid=1393 vsize=15360 CPUtime=6.28 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 4676 0 0 0 628 0 0 0 25 0 1 0 519787155 15728640 3008 33554432000 4194304 4352236 140737343332272 18446744073709551615 4268312 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 3840 3008 127 39 0 2920 0
[pid=1398] ppid=1393 vsize=81708 CPUtime=6.24 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 40835 0 0 0 619 5 0 0 25 0 1 0 519787155 83668992 10738 33554432000 4194304 4331988 140734343368928 18446744073709551615 4210951 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 20427 10738 175 34 0 18869 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 636296

[startup+12.7006 s]
/proc/loadavg: 9.08 9.06 8.97 9/190 1399
/proc/meminfo: memFree=30355780/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=472048 CPUtime=12.69 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 17842 0 0 0 1267 2 0 0 25 0 1 0 519787155 483377152 11966 33554432000 4194304 4587354 140736423504880 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 118012 11966 336 96 0 114574 0
[pid=1395] ppid=1393 vsize=42864 CPUtime=12.68 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 9446 0 0 0 1266 2 0 0 25 0 1 0 519787155 43892736 7988 33554432000 4194304 4785740 140733745071856 18446744073709551615 4553187 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 10716 7988 340 145 0 7761 0
[pid=1397] ppid=1393 vsize=15688 CPUtime=12.68 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 4758 0 0 0 1268 0 0 0 25 0 1 0 519787155 16064512 3090 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328785 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 3922 3090 127 39 0 3002 0
[pid=1398] ppid=1393 vsize=84872 CPUtime=12.61 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 41447 0 0 0 1256 5 0 0 25 0 1 0 519787155 86908928 11350 33554432000 4194304 4331988 140734343368928 18446744073709551615 4226198 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 21218 11350 175 34 0 19660 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 633796

[startup+25.5013 s]
/proc/loadavg: 8.84 9.01 8.95 9/190 1399
/proc/meminfo: memFree=30321020/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=492028 CPUtime=25.49 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 29478 0 0 0 2544 5 0 0 25 0 1 0 519787155 503836672 18820 33554432000 4194304 4587354 140736423504880 18446744073709551615 4388356 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 123007 18820 336 96 0 119569 0
[pid=1395] ppid=1393 vsize=48560 CPUtime=25.49 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 10796 0 0 0 2546 3 0 0 25 0 1 0 519787155 49725440 9338 33554432000 4194304 4785740 140733745071856 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 12140 9338 340 145 0 9185 0
[pid=1397] ppid=1393 vsize=16544 CPUtime=25.48 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 4972 0 0 0 2548 0 0 0 25 0 1 0 519787155 16941056 3304 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328466 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 4136 3304 127 39 0 3216 0
[pid=1398] ppid=1393 vsize=87340 CPUtime=25.33 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 42113 0 0 0 2528 5 0 0 25 0 1 0 519787155 89436160 11997 33554432000 4194304 4331988 140734343368928 18446744073709551615 4211256 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 21835 11997 175 34 0 20277 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 662796

[startup+51.1006 s]
/proc/loadavg: 8.68 8.95 8.94 9/190 1400
/proc/meminfo: memFree=30319380/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=474876 CPUtime=51.09 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 42629 0 0 0 5100 9 0 0 25 0 1 0 519787155 486273024 13686 33554432000 4194304 4587354 140736423504880 18446744073709551615 4237684 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 118719 13686 336 96 0 115281 0
[pid=1395] ppid=1393 vsize=56892 CPUtime=51.08 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 12843 0 0 0 5105 3 0 0 25 0 1 0 519787155 58257408 11385 33554432000 4194304 4785740 140733745071856 18446744073709551615 4552656 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 14223 11385 340 145 0 11268 0
[pid=1397] ppid=1393 vsize=19760 CPUtime=51.09 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 5777 0 0 0 5108 1 0 0 25 0 1 0 519787155 20234240 4108 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 4940 4108 127 39 0 4020 0
[pid=1398] ppid=1393 vsize=90992 CPUtime=50.79 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 43019 0 0 0 5074 5 0 0 25 0 1 0 519787155 93175808 12881 33554432000 4194304 4331988 140734343368928 18446744073709551615 4211224 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 22748 12881 175 34 0 21190 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 660844

[startup+102.3 s]
/proc/loadavg: 8.42 8.84 8.89 9/190 1401
/proc/meminfo: memFree=30251880/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=474316 CPUtime=102.29 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 58590 0 0 0 10215 14 0 0 25 0 1 0 519787155 485699584 14089 33554432000 4194304 4587354 140736423504880 18446744073709551615 271550234299 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 118579 14089 336 96 0 115141 0
[pid=1395] ppid=1393 vsize=72668 CPUtime=102.28 cores=4

################
# More data... #
################


[startup+882.307 s]
/proc/loadavg: 8.27 8.26 8.50 9/190 1434
/proc/meminfo: memFree=29863304/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=523988 CPUtime=882.31 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 159919 0 0 0 88177 54 0 0 25 0 1 0 519787155 536563712 28323 33554432000 4194304 4587354 140736423504880 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 130997 28323 336 96 0 127559 0
[pid=1395] ppid=1393 vsize=147552 CPUtime=882.21 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 34740 0 0 0 88209 12 0 0 25 0 1 0 519787155 151093248 33282 33554432000 4194304 4785740 140733745071856 18446744073709551615 271550235234 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 36888 33282 340 145 0 33933 0
[pid=1397] ppid=1393 vsize=50116 CPUtime=882.31 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 36918 0 0 0 88226 5 0 0 25 0 1 0 519787155 51318784 11697 33554432000 4194304 4352236 140737343332272 18446744073709551615 4231127 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 12529 11697 127 39 0 11609 0
[pid=1398] ppid=1393 vsize=131312 CPUtime=877.49 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 52939 0 0 0 87739 10 0 0 25 0 1 0 519787155 134463488 22801 33554432000 4194304 4331988 140734343368928 18446744073709551615 4226438 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 32828 22801 175 34 0 31270 0
Current children cumulated CPU time (s) 3524.33
Current children cumulated vsize (KiB) 871292

[startup+942.301 s]
/proc/loadavg: 8.17 8.23 8.47 9/190 1436
/proc/meminfo: memFree=29853592/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=522240 CPUtime=942.32 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 162352 0 0 0 94176 56 0 0 25 0 1 0 519787155 534773760 27747 33554432000 4194304 4587354 140736423504880 18446744073709551615 4239534 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 130560 27747 336 96 0 127122 0
[pid=1395] ppid=1393 vsize=149264 CPUtime=942.2 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 35100 0 0 0 94208 12 0 0 25 0 1 0 519787155 152846336 33642 33554432000 4194304 4785740 140733745071856 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 37316 33642 340 145 0 34361 0
[pid=1397] ppid=1393 vsize=58312 CPUtime=942.31 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 39735 0 0 0 94225 6 0 0 25 0 1 0 519787155 59711488 13746 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 14578 13746 127 39 0 13658 0
[pid=1398] ppid=1393 vsize=151872 CPUtime=937.16 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 53555 0 0 0 93706 10 0 0 25 0 1 0 519787155 155516928 23417 33554432000 4194304 4331988 140734343368928 18446744073709551615 4237401 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 37968 23417 175 34 0 36410 0
Current children cumulated CPU time (s) 3764
Current children cumulated vsize (KiB) 900012

[startup+1002.3 s]
/proc/loadavg: 8.13 8.20 8.44 9/190 1437
/proc/meminfo: memFree=29859864/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=523432 CPUtime=1002.32 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 166356 0 0 0 100173 59 0 0 25 0 1 0 519787155 535994368 27747 33554432000 4194304 4587354 140736423504880 18446744073709551615 4241174 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 130858 27747 336 96 0 127420 0
[pid=1395] ppid=1393 vsize=149692 CPUtime=1002.19 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 35230 0 0 0 100207 12 0 0 25 0 1 0 519787155 153284608 33772 33554432000 4194304 4785740 140733745071856 18446744073709551615 4287022 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 37423 33772 340 145 0 34468 0
[pid=1397] ppid=1393 vsize=49096 CPUtime=1002.31 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 40759 0 0 0 100225 6 0 0 25 0 1 0 519787155 50274304 11442 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328832 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 12274 11442 127 39 0 11354 0
[pid=1398] ppid=1393 vsize=152400 CPUtime=996.83 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 53968 0 0 0 99673 10 0 0 25 0 1 0 519787155 156057600 23830 33554432000 4194304 4331988 140734343368928 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 38100 23830 175 34 0 36542 0
Current children cumulated CPU time (s) 4003.66
Current children cumulated vsize (KiB) 892944

[startup+1062.3 s]
/proc/loadavg: 8.55 8.29 8.46 11/191 1472
/proc/meminfo: memFree=30356560/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=522072 CPUtime=1062.31 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 169201 0 0 0 106170 61 0 0 25 0 1 0 519787155 534601728 29047 33554432000 4194304 4587354 140736423504880 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 130518 29047 336 96 0 127080 0
[pid=1395] ppid=1393 vsize=152536 CPUtime=1062.18 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 35894 0 0 0 106206 12 0 0 25 0 1 0 519787155 156196864 34436 33554432000 4194304 4785740 140733745071856 18446744073709551615 4552910 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 38134 34436 340 145 0 35179 0
[pid=1397] ppid=1393 vsize=50120 CPUtime=1062.31 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 43063 0 0 0 106225 6 0 0 25 0 1 0 519787155 51322880 11698 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328105 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 12530 11698 127 39 0 11610 0
[pid=1398] ppid=1393 vsize=152928 CPUtime=1056.51 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 54321 0 0 0 105640 11 0 0 25 0 1 0 519787155 156598272 24183 33554432000 4194304 4331988 140734343368928 18446744073709551615 4237171 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 38232 24183 175 34 0 36674 0
Current children cumulated CPU time (s) 4243.32
Current children cumulated vsize (KiB) 895980

[startup+1122.3 s]
/proc/loadavg: 8.94 8.45 8.50 11/191 1473
/proc/meminfo: memFree=30302916/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=553716 CPUtime=1122.32 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 185880 0 0 0 112168 64 0 0 25 0 1 0 519787155 567005184 33822 33554432000 4194304 4587354 140736423504880 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 138429 33822 336 96 0 134991 0
[pid=1395] ppid=1393 vsize=155236 CPUtime=1122.18 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 36518 0 0 0 112205 13 0 0 25 0 1 0 519787155 158961664 35060 33554432000 4194304 4785740 140733745071856 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 38809 35060 340 145 0 35854 0
[pid=1397] ppid=1393 vsize=54216 CPUtime=1122.32 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 47159 0 0 0 112225 7 0 0 25 0 1 0 519787155 55517184 12722 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328832 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 13554 12722 127 39 0 12634 0
[pid=1398] ppid=1393 vsize=154480 CPUtime=1116.18 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 54715 0 0 0 111607 11 0 0 25 0 1 0 519787155 158187520 24577 33554432000 4194304 4331988 140734343368928 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 38620 24577 175 34 0 37062 0
Current children cumulated CPU time (s) 4483.01
Current children cumulated vsize (KiB) 935972

[startup+1182.3 s]
/proc/loadavg: 9.07 8.57 8.54 11/191 1475
/proc/meminfo: memFree=30254876/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=548540 CPUtime=1182.32 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 188600 0 0 0 118166 66 0 0 25 0 1 0 519787155 561704960 34682 33554432000 4194304 4587354 140736423504880 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 137135 34682 336 96 0 133697 0
[pid=1395] ppid=1393 vsize=157544 CPUtime=1182.17 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 37033 0 0 0 118204 13 0 0 25 0 1 0 519787155 161325056 35575 33554432000 4194304 4785740 140733745071856 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 39386 35575 340 145 0 36431 0
[pid=1397] ppid=1393 vsize=51144 CPUtime=1182.32 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 48439 0 0 0 118225 7 0 0 25 0 1 0 519787155 52371456 11954 33554432000 4194304 4352236 140737343332272 18446744073709551615 4329060 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 12786 11954 127 39 0 11866 0
[pid=1398] ppid=1393 vsize=154888 CPUtime=1175.85 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 55097 0 0 0 117574 11 0 0 25 0 1 0 519787155 158605312 24959 33554432000 4194304 4331988 140734343368928 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 38722 24959 175 34 0 37164 0
Current children cumulated CPU time (s) 4722.67
Current children cumulated vsize (KiB) 930440



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 9.05 8.60 8.55 11/191 1476
/proc/meminfo: memFree=30241840/32951124 swapFree=67111344/67111528
[pid=1393] ppid=1391 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1393/stat : 1393 (ppfolio) S 1391 1393 379 0 -1 4202496 521 1194 0 0 0 0 0 1 15 0 1 0 519787154 18763776 390 33554432000 4194304 4287625 140734524353184 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/1393/statm: 4581 390 342 23 0 91 0
[pid=1394] ppid=1393 vsize=553716 CPUtime=1201.72 cores=0
/proc/1394/stat : 1394 (cryptominisat) R 1393 1393 379 0 -1 4202496 190090 0 0 0 120105 67 0 0 25 0 1 0 519787155 567005184 33865 33554432000 4194304 4587354 140736423504880 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1394/statm: 138429 33865 336 96 0 134991 0
[pid=1395] ppid=1393 vsize=158732 CPUtime=1201.57 cores=4
/proc/1395/stat : 1395 (clasp) R 1393 1393 379 0 -1 4202496 37355 0 0 0 120144 13 0 0 25 0 1 0 519787155 162541568 35897 33554432000 4194304 4785740 140733745071856 18446744073709551615 4553054 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1395/statm: 39683 35897 340 145 0 36728 0
[pid=1397] ppid=1393 vsize=51144 CPUtime=1201.72 cores=2
/proc/1397/stat : 1397 (lingeling) R 1393 1393 379 0 -1 4202496 49719 0 0 0 120165 7 0 0 25 0 1 0 519787155 52371456 11954 33554432000 4194304 4352236 140737343332272 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1397/statm: 12786 11954 127 39 0 11866 0
[pid=1398] ppid=1393 vsize=155020 CPUtime=1195.14 cores=6
/proc/1398/stat : 1398 (march_hi) R 1393 1393 379 0 -1 4202496 55209 0 0 0 119503 11 0 0 25 0 1 0 519787155 158740480 25071 33554432000 4194304 4331988 140734343368928 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1398/statm: 38755 25071 175 34 0 37197 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 936936

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1393 and gives
#  childrusage.ru_utime.tv_sec=1201
#  childrusage.ru_utime.tv_usec=664319
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=94985
# CPU time returned by wait4() is 1201.76
# while last known CPU time is 4800.16
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.16
CPU user time (s): 4799.17
CPU system time (s): 0.99
CPU usage (%): 399.443
Max. virtual memory (cumulated for all children) (KiB): 1232648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1201.66
system time used= 0.094985
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 51435
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 364
involuntary context switches= 51490

runsolver used 1.9787 second user time and 4.5863 second system time

The end

Launcher Data 

Begin job on node133 at 2011-04-29 14:58:13
IDJOB=3289720
IDBENCH=83134
IDSOLVER=1612
FILE ID=node133/3289720-1304081893
RUNJOBID= node133-1304077694-397
PBS_JOBID= 13170511
Free space on /tmp= 71876 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom17.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289720-1304081893/watcher-3289720-1304081893 -o /tmp/evaluation-result-3289720-1304081893/solver-3289720-1304081893 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3289720-1304081893.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a6df2ce216327c64a0156683acb72fc2
RANDOM SEED=1951770664

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30495448 kB
Buffers:        738980 kB
Cached:         981276 kB
SwapCached:        124 kB
Active:         929944 kB
Inactive:      1168044 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30495448 kB
SwapTotal:    67111528 kB
SwapFree:     67111344 kB
Dirty:           11688 kB
Writeback:           0 kB
AnonPages:      377928 kB
Mapped:          16552 kB
Slab:           294200 kB
PageTables:       6024 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   835340 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71872 MiB
End job on node133 at 2011-04-29 15:18:16