Trace number 3291974

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (MO) 3138.01 785.616

General information on the benchmark

NameSAT04/industrial/velev/vliw_unsat_2.0/
9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf
MD5SUM776da55785376fd8eac6989ca812b102
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1002.78
Satisfiable
(Un)Satisfiability was proved
Number of variables371419
Number of clauses7170909
Sum of the clauses size20872419
Maximum clause length205
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 26770451
Number of clauses of size 392326
Number of clauses of size 48862
Number of clauses of size 523554
Number of clauses of size over 5275715

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7
0.00/0.05

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3291974-1304094379/watcher-3291974-1304094379 -o /tmp/evaluation-result-3291974-1304094379/solver-3291974-1304094379 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3291974-1304094379.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.90 10.05 9.04 6/182 24525
/proc/meminfo: memFree=18490252/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) R 24523 24525 23533 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 521036313 18763776 390 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/24525/statm: 4581 390 341 23 0 91 0

[startup+0.028787 s]
/proc/loadavg: 9.90 10.05 9.04 6/182 24525
/proc/meminfo: memFree=18490252/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) R 24523 24525 23533 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 521036313 18763776 390 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/24525/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100774 s]
/proc/loadavg: 9.90 10.05 9.04 6/182 24525
/proc/meminfo: memFree=18490252/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 25 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195386380386304 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300737 s]
/proc/loadavg: 9.90 10.05 9.04 6/182 24525
/proc/meminfo: memFree=18490252/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 25 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195386380386304 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700665 s]
/proc/loadavg: 9.90 10.05 9.04 6/182 24525
/proc/meminfo: memFree=18490252/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 25 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195386380386304 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50052 s]
/proc/loadavg: 9.90 10.05 9.04 10/187 24531
/proc/meminfo: memFree=17970028/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 25 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195386380386304 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=359808 CPUtime=1.48 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 75030 0 0 0 137 11 0 0 25 0 1 0 521036313 368443392 74404 33554432000 4194304 4587354 140734599570144 18446744073709551615 228122410644 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 89952 74404 287 96 0 86514 0
[pid=24527] ppid=24525 vsize=155192 CPUtime=1.49 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 38043 0 0 0 140 9 0 0 25 0 1 0 521036313 158916608 35212 33554432000 4194304 4785740 140736314666928 18446744073709551615 228122713856 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 38798 35213 308 145 0 35843 0
[pid=24529] ppid=24525 vsize=101504 CPUtime=1.48 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 24731 0 0 0 143 5 0 0 25 0 1 0 521036313 103940096 24544 33554432000 4194304 4352236 140734711754608 18446744073709551615 228122713856 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 25376 24544 101 39 0 24456 0
[pid=24530] ppid=24525 vsize=210508 CPUtime=1.46 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4194304 46249 0 0 0 139 7 0 0 25 0 1 0 521036313 215560192 46144 33554432000 4194304 4331988 140733312266976 18446744073709551615 228122374823 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 52627 46144 113 34 0 51069 0
Current children cumulated CPU time (s) 5.91
Current children cumulated vsize (KiB) 845336

[startup+3.10124 s]
/proc/loadavg: 9.90 10.05 9.04 10/187 24531
/proc/meminfo: memFree=17558596/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 18 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195738567704576 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=565284 CPUtime=3.08 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 128644 0 0 0 288 20 0 0 25 0 1 0 521036313 578850816 127650 33554432000 4194304 4587354 140734599570144 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 141321 127650 306 96 0 137883 0
[pid=24527] ppid=24525 vsize=214860 CPUtime=3.09 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 60550 0 0 0 295 14 0 0 25 0 1 0 521036313 220016640 50373 33554432000 4194304 4785740 140736314666928 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 53715 50373 328 145 0 50760 0
[pid=24529] ppid=24525 vsize=199040 CPUtime=3.09 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 49115 0 0 0 297 12 0 0 25 0 1 0 521036313 203816960 48928 33554432000 4194304 4352236 140734711754608 18446744073709551615 228122713856 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 49760 48928 101 39 0 48840 0
[pid=24530] ppid=24525 vsize=298816 CPUtime=3.06 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4194304 70824 0 0 0 292 14 0 0 25 0 1 0 521036313 305987584 70719 33554432000 4194304 4331988 140733312266976 18446744073709551615 228122261887 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 74704 70719 113 34 0 73146 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 1296324

[startup+6.30066 s]
/proc/loadavg: 9.83 10.03 9.04 6/179 24552
/proc/meminfo: memFree=16953128/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=803932 CPUtime=6.29 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 186638 0 0 0 600 29 0 0 25 0 1 0 521036313 823226368 185644 33554432000 4194304 4587354 140734599570144 18446744073709551615 4365232 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 200983 185644 310 96 0 197545 0
[pid=24527] ppid=24525 vsize=224484 CPUtime=6.29 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 62911 0 0 0 614 15 0 0 25 0 1 0 521036313 229871616 52734 33554432000 4194304 4785740 140736314666928 18446744073709551615 4552635 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 56121 52734 336 145 0 53166 0
[pid=24529] ppid=24525 vsize=198812 CPUtime=6.29 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 78673 0 0 0 613 16 0 0 25 0 1 0 521036313 203583488 48854 33554432000 4194304 4352236 140734711754608 18446744073709551615 4256354 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 49703 48854 116 39 0 48783 0
[pid=24530] ppid=24525 vsize=771356 CPUtime=6.24 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4194304 141620 0 0 0 597 27 0 0 25 0 1 0 521036313 789868544 108208 33554432000 4194304 4331988 140733312266976 18446744073709551615 4257024 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 192839 108208 125 34 0 191281 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 2016908

[startup+12.7005 s]
/proc/loadavg: 9.84 10.03 9.05 10/187 24563
/proc/meminfo: memFree=15692308/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=794388 CPUtime=12.69 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 187070 0 0 0 1240 29 0 0 25 0 1 0 521036313 813453312 183174 33554432000 4194304 4587354 140734599570144 18446744073709551615 4232269 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 198597 183174 324 96 0 195159 0
[pid=24527] ppid=24525 vsize=231128 CPUtime=12.69 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 64539 0 0 0 1254 15 0 0 25 0 1 0 521036313 236675072 54362 33554432000 4194304 4785740 140736314666928 18446744073709551615 4545986 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 57782 54362 336 145 0 54827 0
[pid=24529] ppid=24525 vsize=215200 CPUtime=12.69 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 82786 0 0 0 1252 17 0 0 25 0 1 0 521036313 220364800 52967 33554432000 4194304 4352236 140734711754608 18446744073709551615 4229896 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 53800 52967 125 39 0 52880 0
[pid=24530] ppid=24525 vsize=754956 CPUtime=12.6 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4194304 261523 0 0 0 1216 44 0 0 25 0 1 0 521036313 773074944 117273 33554432000 4194304 4331988 140733312266976 18446744073709551615 4256835 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 188739 117273 128 34 0 187181 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 2013996

[startup+25.5012 s]
/proc/loadavg: 9.66 9.98 9.04 10/187 24563
/proc/meminfo: memFree=15144692/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=794388 CPUtime=25.49 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 187401 0 0 0 2520 29 0 0 25 0 1 0 521036313 813453312 183500 33554432000 4194304 4587354 140734599570144 18446744073709551615 4238065 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 198597 183500 332 96 0 195159 0
[pid=24527] ppid=24525 vsize=241320 CPUtime=25.49 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 67058 0 0 0 2533 16 0 0 25 0 1 0 521036313 247111680 56881 33554432000 4194304 4785740 140736314666928 18446744073709551615 4319144 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 60330 56881 336 145 0 57375 0
[pid=24529] ppid=24525 vsize=243688 CPUtime=25.49 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 89978 0 0 0 2531 18 0 0 25 0 1 0 521036313 249536512 60091 33554432000 4194304 4352236 140734711754608 18446744073709551615 4241364 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 60922 60091 127 39 0 60002 0
[pid=24530] ppid=24525 vsize=947204 CPUtime=25.33 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 531748 0 0 0 2447 86 0 0 25 0 1 0 521036313 969936896 161778 33554432000 4194304 4331988 140733312266976 18446744073709551615 4252211 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 236801 161778 147 34 0 235243 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 2244924

[startup+51.1006 s]
/proc/loadavg: 9.49 9.92 9.05 10/187 24564
/proc/meminfo: memFree=15057460/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=794388 CPUtime=51.09 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 188178 0 0 0 5080 29 0 0 25 0 1 0 521036313 813453312 184260 33554432000 4194304 4587354 140734599570144 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 198597 184260 332 96 0 195159 0
[pid=24527] ppid=24525 vsize=292296 CPUtime=51.08 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 79708 0 0 0 5088 20 0 0 25 0 1 0 521036313 299311104 69531 33554432000 4194304 4785740 140736314666928 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 73074 69531 336 145 0 70119 0
[pid=24529] ppid=24525 vsize=253456 CPUtime=51.07 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 117180 0 0 0 5086 21 0 0 25 0 1 0 521036313 259538944 62533 33554432000 4194304 4352236 140734711754608 18446744073709551615 4267912 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 63364 62533 127 39 0 62444 0
[pid=24530] ppid=24525 vsize=917212 CPUtime=50.79 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 848292 0 0 0 4944 135 0 0 25 0 1 0 521036313 939225088 157202 33554432000 4194304 4331988 140733312266976 18446744073709551615 4271172 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 229303 157202 150 34 0 227745 0
Current children cumulated CPU time (s) 204.03
Current children cumulated vsize (KiB) 2275676

[startup+102.307 s]
/proc/loadavg: 9.32 9.80 9.05 10/187 24565
/proc/meminfo: memFree=14794164/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=794688 CPUtime=102.29 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 189231 0 0 0 10200 29 0 0 25 0 1 0 521036313 813760512 185298 33554432000 4194304 4587354 140734599570144 18446744073709551615 4420825 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 198672 185298 344 96 0 195234 0
[pid=24527] ppid=24525 vsize=391648 CPUtime=102.29 cores=5

################
# More data... #
################


[startup+462.3 s]
/proc/loadavg: 9.16 9.35 9.09 10/187 24575
/proc/meminfo: memFree=8312248/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=2163256 CPUtime=462.3 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 976147 0 0 0 46097 133 0 0 25 0 1 0 521036313 2215174144 243759 33554432000 4194304 4587354 140734599570144 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 540814 243759 346 96 0 537376 0
[pid=24527] ppid=24525 vsize=1940508 CPUtime=462.28 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 490061 0 0 0 46140 88 0 0 25 0 1 0 521036313 1987080192 479884 33554432000 4194304 4785740 140736314666928 18446744073709551615 4319104 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 485127 479884 336 145 0 482172 0
[pid=24529] ppid=24525 vsize=248168 CPUtime=462.24 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 254868 0 0 0 46184 40 0 0 25 0 1 0 521036313 254124032 61211 33554432000 4194304 4352236 140734711754608 18446744073709551615 4238648 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 62042 61211 127 39 0 61122 0
[pid=24530] ppid=24525 vsize=2757880 CPUtime=459.76 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 1303157 0 0 0 45716 260 0 0 25 0 1 0 521036313 2824069120 612067 33554432000 4194304 4331988 140733312266976 18446744073709551615 4271544 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 689470 612067 151 34 0 687912 0
Current children cumulated CPU time (s) 1846.58
Current children cumulated vsize (KiB) 7128136

[startup+522.301 s]
/proc/loadavg: 9.21 9.33 9.09 10/187 24577
/proc/meminfo: memFree=6353392/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=1072760 CPUtime=522.3 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 988432 0 0 0 52095 135 0 0 25 0 1 0 521036313 1098506240 241967 33554432000 4194304 4587354 140734599570144 18446744073709551615 4449056 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 268190 241967 346 96 0 264752 0
[pid=24527] ppid=24525 vsize=2192576 CPUtime=522.28 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 552685 0 0 0 52127 101 0 0 25 0 1 0 521036313 2245197824 542508 33554432000 4194304 4785740 140736314666928 18446744073709551615 4552646 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 548144 542508 336 145 0 545189 0
[pid=24529] ppid=24525 vsize=305644 CPUtime=522.23 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 277668 0 0 0 52181 42 0 0 25 0 1 0 521036313 312979456 75580 33554432000 4194304 4352236 140734711754608 18446744073709551615 4231360 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 76411 75580 127 39 0 75491 0
[pid=24530] ppid=24525 vsize=3791140 CPUtime=519.44 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 1544053 0 0 0 51638 306 0 0 25 0 1 0 521036313 3882127360 852963 33554432000 4194304 4331988 140733312266976 18446744073709551615 4226625 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 947785 852963 151 34 0 946227 0
Current children cumulated CPU time (s) 2086.25
Current children cumulated vsize (KiB) 7380444

[startup+582.301 s]
/proc/loadavg: 9.19 9.30 9.09 10/187 24578
/proc/meminfo: memFree=4671056/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=1281472 CPUtime=582.3 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 1075839 0 0 0 58084 146 0 0 25 0 1 0 521036313 1312227328 242513 33554432000 4194304 4587354 140734599570144 18446744073709551615 4237587 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 320368 242513 346 96 0 316930 0
[pid=24527] ppid=24525 vsize=2529520 CPUtime=582.28 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 636623 0 0 0 58113 115 0 0 25 0 1 0 521036313 2590228480 626446 33554432000 4194304 4785740 140736314666928 18446744073709551615 4553747 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 632380 626446 336 145 0 629425 0
[pid=24529] ppid=24525 vsize=279104 CPUtime=582.24 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 285861 0 0 0 58181 43 0 0 25 0 1 0 521036313 285802496 68945 33554432000 4194304 4352236 140734711754608 18446744073709551615 4233914 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 69776 68945 127 39 0 68856 0
[pid=24530] ppid=24525 vsize=4752892 CPUtime=579.11 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 1791374 0 0 0 57561 350 0 0 25 0 1 0 521036313 4866961408 1100284 33554432000 4194304 4331988 140733312266976 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 1188223 1100284 151 34 0 1186665 0
Current children cumulated CPU time (s) 2325.93
Current children cumulated vsize (KiB) 8861312

[startup+642.301 s]
/proc/loadavg: 9.17 9.27 9.09 10/187 24580
/proc/meminfo: memFree=3018864/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=2476912 CPUtime=642.31 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 1120732 0 0 0 64077 154 0 0 25 0 1 0 521036313 2536357888 240615 33554432000 4194304 4587354 140734599570144 18446744073709551615 4249360 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 619228 240615 346 96 0 615790 0
[pid=24527] ppid=24525 vsize=2815416 CPUtime=642.29 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 707895 0 0 0 64101 128 0 0 25 0 1 0 521036313 2882985984 697718 33554432000 4194304 4785740 140736314666928 18446744073709551615 4279309 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 703854 697718 336 145 0 700899 0
[pid=24529] ppid=24525 vsize=303828 CPUtime=642.25 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 292055 0 0 0 64181 44 0 0 25 0 1 0 521036313 311119872 75126 33554432000 4194304 4352236 140734711754608 18446744073709551615 4207831 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 75957 75126 127 39 0 75037 0
[pid=24530] ppid=24525 vsize=5724148 CPUtime=638.79 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 2041075 0 0 0 63485 394 0 0 25 0 1 0 521036313 5861527552 1349985 33554432000 4194304 4331988 140733312266976 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 1431037 1349985 151 34 0 1429479 0
Current children cumulated CPU time (s) 2565.64
Current children cumulated vsize (KiB) 11338628

[startup+702.301 s]
/proc/loadavg: 9.24 9.27 9.10 10/187 24581
/proc/meminfo: memFree=1382920/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=3113792 CPUtime=702.3 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 1132994 0 0 0 70074 156 0 0 25 0 1 0 521036313 3188523008 239786 33554432000 4194304 4587354 140734599570144 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 778448 239786 346 96 0 775010 0
[pid=24527] ppid=24525 vsize=3096212 CPUtime=702.28 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 777038 0 0 0 70088 140 0 0 25 0 1 0 521036313 3170521088 766861 33554432000 4194304 4785740 140736314666928 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 774053 766861 336 145 0 771098 0
[pid=24529] ppid=24525 vsize=278012 CPUtime=702.25 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 300248 0 0 0 70180 45 0 0 25 0 1 0 521036313 284684288 68672 33554432000 4194304 4352236 140734711754608 18446744073709551615 4319064 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 69503 68672 127 39 0 68583 0
[pid=24530] ppid=24525 vsize=6758236 CPUtime=698.46 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 2306655 0 0 0 69408 438 0 0 25 0 1 0 521036313 6920433664 1615565 33554432000 4194304 4331988 140733312266976 18446744073709551615 4271138 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 1689559 1615565 151 34 0 1688001 0
Current children cumulated CPU time (s) 2805.29
Current children cumulated vsize (KiB) 13264576

[startup+762.307 s]
/proc/loadavg: 9.14 9.23 9.09 10/187 24583
/proc/meminfo: memFree=95732/32951124 swapFree=67111528/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=3110520 CPUtime=762.31 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 1220523 0 0 0 76061 170 0 0 25 0 1 0 521036313 3185172480 240920 33554432000 4194304 4587354 140734599570144 18446744073709551615 4250392 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 777630 240920 346 96 0 774192 0
[pid=24527] ppid=24525 vsize=3393576 CPUtime=762.29 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 850779 0 0 0 76073 156 0 0 25 0 1 0 521036313 3475021824 840602 33554432000 4194304 4785740 140736314666928 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 848394 840602 336 145 0 845439 0
[pid=24529] ppid=24525 vsize=301744 CPUtime=762.25 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 314375 0 0 0 76179 46 0 0 25 0 1 0 521036313 308985856 74605 33554432000 4194304 4352236 140734711754608 18446744073709551615 4329060 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 75436 74605 127 39 0 74516 0
[pid=24530] ppid=24525 vsize=7793176 CPUtime=758.13 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 2522451 0 0 0 75331 482 0 0 25 0 1 0 521036313 7980212224 1831361 33554432000 4194304 4331988 140733312266976 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 1948294 1831361 151 34 0 1946736 0
Current children cumulated CPU time (s) 3044.98
Current children cumulated vsize (KiB) 14617340



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+785.601 s]
/proc/loadavg: 9.09 9.21 9.09 10/187 24584
/proc/meminfo: memFree=95700/32951124 swapFree=67111524/67111528
[pid=24525] ppid=24523 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/24525/stat : 24525 (ppfolio) S 24523 24525 23533 0 -1 4202496 525 215 0 0 0 0 0 0 15 0 1 0 521036313 18763776 391 33554432000 4194304 4287625 140733753632656 18446744073709551615 228122734095 0 0 4096 65536 9224195742862639365 0 0 17 1 0 0 0
/proc/24525/statm: 4581 391 342 23 0 91 0
[pid=24526] ppid=24525 vsize=4263004 CPUtime=785.61 cores=1
/proc/24526/stat : 24526 (cryptominisat) R 24525 24525 23533 0 -1 4202496 1230720 0 0 0 78389 172 0 0 25 0 1 0 521036313 4365316096 251104 33554432000 4194304 4587354 140734599570144 18446744073709551615 228122410652 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/24526/statm: 1065751 251104 346 96 0 1062313 0
[pid=24527] ppid=24525 vsize=3491964 CPUtime=785.59 cores=5
/proc/24527/stat : 24527 (clasp) R 24525 24525 23533 0 -1 4202496 875294 0 0 0 78399 160 0 0 25 0 1 0 521036313 3575771136 865117 33554432000 4194304 4785740 140736314666928 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24527/statm: 872991 865117 336 145 0 870036 0
[pid=24529] ppid=24525 vsize=277792 CPUtime=785.56 cores=3
/proc/24529/stat : 24529 (lingeling) R 24525 24525 23533 0 -1 4202496 314375 0 0 0 78509 47 0 0 25 0 1 0 521036313 284459008 68617 33554432000 4194304 4352236 140734711754608 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/24529/statm: 69448 68617 127 39 0 68528 0
[pid=24530] ppid=24525 vsize=8108920 CPUtime=781.25 cores=7
/proc/24530/stat : 24530 (march_hi) R 24525 24525 23533 0 -1 4202496 2604037 0 0 0 77627 498 0 0 25 0 1 0 521036313 8303534080 1912947 33554432000 4194304 4331988 140733312266976 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/24530/statm: 2027230 1912947 151 34 0 2025672 0
Current children cumulated CPU time (s) 3138.01
Current children cumulated vsize (KiB) 16160004

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24525 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.004998
# while last known CPU time is 3138.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 785.616
CPU time (s): 3138.01
CPU user time (s): 3129.24
CPU system time (s): 8.77
CPU usage (%): 399.433
Max. virtual memory (cumulated for all children) (KiB): 16160004

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 740
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 181
involuntary context switches= 8

runsolver used 1.13083 second user time and 3.16552 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-29 18:26:23
IDJOB=3291974
IDBENCH=85005
IDSOLVER=1612
FILE ID=node138/3291974-1304094379
RUNJOBID= node138-1304093161-24370
PBS_JOBID= 13170556
Free space on /tmp= 71652 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT04/industrial/velev/vliw_unsat_2.0/9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3291974-1304094379/watcher-3291974-1304094379 -o /tmp/evaluation-result-3291974-1304094379/solver-3291974-1304094379 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3291974-1304094379.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 776da55785376fd8eac6989ca812b102
RANDOM SEED=337101720

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18490532 kB
Buffers:       2042376 kB
Cached:       11656388 kB
SwapCached:          0 kB
Active:        3610184 kB
Inactive:     10278424 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18490532 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          177884 kB
Writeback:           0 kB
AnonPages:      189152 kB
Mapped:          16768 kB
Slab:           507900 kB
PageTables:       5452 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1918544 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71568 MiB
End job on node138 at 2011-04-29 18:39:31