Trace number 3289398

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.23 1201.71

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top25.cnf
MD5SUM1d36146d5d79c91e0605a19242395228
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark527.919
Satisfiable
(Un)Satisfiability was proved
Number of variables71356
Number of clauses227126
Sum of the clauses size555264
Maximum clause length2747
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2137909
Number of clauses of size 387742
Number of clauses of size 4324
Number of clauses of size 523
Number of clauses of size over 51127

Solver Data 

0.00/0.80	This is pico-portfolio, a naive parallel portfolio
0.00/0.80	Copyright (C) 2011 Olivier Roussel
0.00/0.80	Using 4 processing units
0.00/0.80	This portfolio uses the following solvers:
0.00/0.80	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.80	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.80	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.80	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.80	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.80	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.80	Starting clasp 1.3.6 on core(s) 4
0.00/0.80	Starting TNM 2009 on core(s) 6
0.00/0.80	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.80	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289398-1304081349/watcher-3289398-1304081349 -o /tmp/evaluation-result-3289398-1304081349/solver-3289398-1304081349 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3289398-1304081349.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.03 8.07 8.41 5/181 1333
/proc/meminfo: memFree=20315336/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) R 1331 1333 567 0 -1 4194304 481 0 0 0 0 0 0 0 25 0 1 0 598365575 18763776 388 33554432000 4194304 4287625 140735856674800 18446744073709551615 231894888411 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/1333/statm: 4581 388 339 23 0 91 0

[startup+0.088076 s]
/proc/loadavg: 8.03 8.07 8.41 5/181 1333
/proc/meminfo: memFree=20315336/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) R 1331 1333 567 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 598365575 18763776 390 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/1333/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101073 s]
/proc/loadavg: 8.03 8.07 8.41 5/181 1333
/proc/meminfo: memFree=20315336/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) R 1331 1333 567 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 598365575 18763776 390 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/1333/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301039 s]
/proc/loadavg: 8.03 8.07 8.41 5/181 1333
/proc/meminfo: memFree=20315336/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) R 1331 1333 567 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 598365575 18763776 390 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/1333/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700964 s]
/proc/loadavg: 8.03 8.07 8.41 5/181 1333
/proc/meminfo: memFree=20315336/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) R 1331 1333 567 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 598365575 18763776 390 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/1333/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50081 s]
/proc/loadavg: 8.03 8.07 8.41 10/186 1339
/proc/meminfo: memFree=20199460/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 17 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=62284 CPUtime=1.49 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 10022 0 0 0 148 1 0 0 20 0 1 0 598365575 63778816 9741 33554432000 4194304 4587354 140736259423104 18446744073709551615 4364588 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 15571 9741 311 96 0 12133 0
[pid=1335] ppid=1333 vsize=50900 CPUtime=1.48 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 12853 0 0 0 147 1 0 0 20 0 1 0 598365575 52121600 9732 33554432000 4194304 4785740 140733772797760 18446744073709551615 4550319 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 12725 9732 340 145 0 9770 0
[pid=1337] ppid=1333 vsize=23524 CPUtime=1.48 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 8070 0 0 0 147 1 0 0 25 0 1 0 598365575 24088576 5035 33554432000 4194304 4352236 140733587078176 18446744073709551615 4319064 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 5881 5035 119 39 0 4961 0
[pid=1338] ppid=1333 vsize=48496 CPUtime=1.46 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 60120 0 0 0 138 8 0 0 25 0 1 0 598365575 49659904 8531 33554432000 4194304 4331988 140737150192224 18446744073709551615 231895146503 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 12124 8531 151 34 0 10566 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 203528

[startup+3.10051 s]
/proc/loadavg: 8.03 8.07 8.41 9/186 1339
/proc/meminfo: memFree=20145148/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=91412 CPUtime=3.08 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 19253 0 0 0 306 2 0 0 25 0 1 0 598365575 93605888 17355 33554432000 4194304 4587354 140736259423104 18446744073709551615 4373280 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 22853 17355 317 96 0 19415 0
[pid=1335] ppid=1333 vsize=50900 CPUtime=3.08 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 12858 0 0 0 307 1 0 0 25 0 1 0 598365575 52121600 9737 33554432000 4194304 4785740 140733772797760 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 12725 9737 340 145 0 9770 0
[pid=1337] ppid=1333 vsize=30108 CPUtime=3.09 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 9330 0 0 0 307 2 0 0 25 0 1 0 598365575 30830592 6295 33554432000 4194304 4352236 140733587078176 18446744073709551615 4227869 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 7527 6295 125 39 0 6607 0
[pid=1338] ppid=1333 vsize=160076 CPUtime=3.05 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 87022 0 0 0 294 11 0 0 25 0 1 0 598365575 163917824 20558 33554432000 4194304 4331988 140737150192224 18446744073709551615 4210940 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 40019 20558 179 34 0 38461 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 350820

[startup+6.30091 s]
/proc/loadavg: 8.03 8.07 8.41 9/186 1339
/proc/meminfo: memFree=20095908/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=126808 CPUtime=6.29 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 21900 0 0 0 626 3 0 0 25 0 1 0 598365575 129851392 17688 33554432000 4194304 4587354 140736259423104 18446744073709551615 4238285 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 31702 17688 330 96 0 28264 0
[pid=1335] ppid=1333 vsize=53156 CPUtime=6.29 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 13530 0 0 0 627 2 0 0 25 0 1 0 598365575 54431744 10409 33554432000 4194304 4785740 140733772797760 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 13289 10409 340 145 0 10334 0
[pid=1337] ppid=1333 vsize=30108 CPUtime=6.29 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 9330 0 0 0 627 2 0 0 25 0 1 0 598365575 30830592 6295 33554432000 4194304 4352236 140733587078176 18446744073709551615 4230722 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 7527 6295 125 39 0 6607 0
[pid=1338] ppid=1333 vsize=168444 CPUtime=6.23 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 88901 0 0 0 611 12 0 0 25 0 1 0 598365575 172486656 22433 33554432000 4194304 4331988 140737150192224 18446744073709551615 231895186919 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 42111 22433 175 34 0 40553 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 396840

[startup+12.7007 s]
/proc/loadavg: 8.10 8.08 8.41 10/186 1339
/proc/meminfo: memFree=20077604/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=126808 CPUtime=12.69 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 22247 0 0 0 1266 3 0 0 25 0 1 0 598365575 129851392 18028 33554432000 4194304 4587354 140736259423104 18446744073709551615 4239575 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 31702 18028 336 96 0 28264 0
[pid=1335] ppid=1333 vsize=62188 CPUtime=12.68 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 15741 0 0 0 1266 2 0 0 25 0 1 0 598365575 63680512 12620 33554432000 4194304 4785740 140733772797760 18446744073709551615 4550292 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 15547 12620 340 145 0 12592 0
[pid=1337] ppid=1333 vsize=25844 CPUtime=12.68 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 9332 0 0 0 1266 2 0 0 25 0 1 0 598365575 26464256 5231 33554432000 4194304 4352236 140733587078176 18446744073709551615 4328039 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 6461 5231 127 39 0 5541 0
[pid=1338] ppid=1333 vsize=169704 CPUtime=12.59 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 89260 0 0 0 1247 12 0 0 25 0 1 0 598365575 173776896 22792 33554432000 4194304 4331988 140737150192224 18446744073709551615 4243048 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 42426 22792 175 34 0 40868 0
Current children cumulated CPU time (s) 50.65
Current children cumulated vsize (KiB) 402868

[startup+25.5003 s]
/proc/loadavg: 8.08 8.08 8.41 9/186 1340
/proc/meminfo: memFree=20052892/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=987240 CPUtime=25.49 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 32799 0 0 0 2542 7 0 0 25 0 1 0 598365575 1010933760 19239 33554432000 4194304 4587354 140736259423104 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 246810 19239 338 96 0 243372 0
[pid=1335] ppid=1333 vsize=70840 CPUtime=25.48 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 17842 0 0 0 2545 3 0 0 25 0 1 0 598365575 72540160 14721 33554432000 4194304 4785740 140733772797760 18446744073709551615 4549788 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 17710 14721 340 145 0 14755 0
[pid=1337] ppid=1333 vsize=29928 CPUtime=25.48 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 10356 0 0 0 2546 2 0 0 25 0 1 0 598365575 30646272 6252 33554432000 4194304 4352236 140733587078176 18446744073709551615 4233979 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 7482 6252 127 39 0 6562 0
[pid=1338] ppid=1333 vsize=170392 CPUtime=25.32 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 89452 0 0 0 2520 12 0 0 25 0 1 0 598365575 174481408 22984 33554432000 4194304 4331988 140737150192224 18446744073709551615 4226434 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 42598 22984 175 34 0 41040 0
Current children cumulated CPU time (s) 101.78
Current children cumulated vsize (KiB) 1276724

[startup+51.1005 s]
/proc/loadavg: 8.05 8.07 8.39 10/186 1340
/proc/meminfo: memFree=20021692/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=1018412 CPUtime=51.08 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 43851 0 0 0 5099 9 0 0 25 0 1 0 598365575 1042853888 24446 33554432000 4194304 4587354 140736259423104 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 254603 24446 336 96 0 251165 0
[pid=1335] ppid=1333 vsize=80276 CPUtime=51.08 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 20083 0 0 0 5104 4 0 0 25 0 1 0 598365575 82202624 16962 33554432000 4194304 4785740 140733772797760 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 20069 16962 340 145 0 17114 0
[pid=1337] ppid=1333 vsize=29924 CPUtime=51.08 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 11380 0 0 0 5106 2 0 0 25 0 1 0 598365575 30642176 6251 33554432000 4194304 4352236 140733587078176 18446744073709551615 4309684 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 7481 6251 127 39 0 6561 0
[pid=1338] ppid=1333 vsize=170712 CPUtime=50.79 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 89535 0 0 0 5066 13 0 0 25 0 1 0 598365575 174809088 23067 33554432000 4194304 4331988 140737150192224 18446744073709551615 4242940 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 42678 23067 175 34 0 41120 0
Current children cumulated CPU time (s) 204.04
Current children cumulated vsize (KiB) 1317648

[startup+102.307 s]
/proc/loadavg: 8.06 8.07 8.37 10/186 1342
/proc/meminfo: memFree=20000832/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=1001212 CPUtime=102.29 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 58783 0 0 0 10215 14 0 0 25 0 1 0 598365575 1025241088 23362 33554432000 4194304 4587354 140736259423104 18446744073709551615 4236364 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 250303 23362 336 96 0 246865 0
[pid=1335] ppid=1333 vsize=97380 CPUtime=102.28 cores=4

################
# More data... #
################


[startup+942.301 s]
/proc/loadavg: 9.10 8.69 8.45 10/187 1438
/proc/meminfo: memFree=20120884/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=216360 CPUtime=942.31 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 174704 0 0 0 94171 60 0 0 25 0 1 0 598365575 221552640 28048 33554432000 4194304 4587354 140736259423104 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 54090 28048 336 96 0 50652 0
[pid=1335] ppid=1333 vsize=195260 CPUtime=942.25 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 47768 0 0 0 94212 13 0 0 25 0 1 0 598365575 199946240 44647 33554432000 4194304 4785740 140733772797760 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 48815 44647 340 145 0 45860 0
[pid=1337] ppid=1333 vsize=51052 CPUtime=942.29 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 49063 0 0 0 94220 9 0 0 25 0 1 0 598365575 52277248 11931 33554432000 4194304 4352236 140733587078176 18446744073709551615 4207645 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 12763 11931 127 39 0 11843 0
[pid=1338] ppid=1333 vsize=178188 CPUtime=937.15 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 91141 0 0 0 93702 13 0 0 25 0 1 0 598365575 182464512 24673 33554432000 4194304 4331988 140737150192224 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 44547 24673 175 34 0 42989 0
Current children cumulated CPU time (s) 3764.01
Current children cumulated vsize (KiB) 659184

[startup+1002.3 s]
/proc/loadavg: 9.08 8.76 8.48 10/187 1440
/proc/meminfo: memFree=20093080/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=1018140 CPUtime=1002.31 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 181951 0 0 0 100167 64 0 0 25 0 1 0 598365575 1042575360 28423 33554432000 4194304 4587354 140736259423104 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 254535 28423 336 96 0 251097 0
[pid=1335] ppid=1333 vsize=195260 CPUtime=1002.25 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 47806 0 0 0 100212 13 0 0 25 0 1 0 598365575 199946240 44685 33554432000 4194304 4785740 140733772797760 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 48815 44685 340 145 0 45860 0
[pid=1337] ppid=1333 vsize=51052 CPUtime=1002.28 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 49575 0 0 0 100219 9 0 0 25 0 1 0 598365575 52277248 11931 33554432000 4194304 4352236 140733587078176 18446744073709551615 4329165 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 12763 11931 127 39 0 11843 0
[pid=1338] ppid=1333 vsize=178188 CPUtime=996.82 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 91177 0 0 0 99669 13 0 0 25 0 1 0 598365575 182464512 24709 33554432000 4194304 4331988 140737150192224 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 44547 24709 175 34 0 42989 0
Current children cumulated CPU time (s) 4003.67
Current children cumulated vsize (KiB) 1460964

[startup+1062.3 s]
/proc/loadavg: 9.12 8.83 8.52 10/187 1441
/proc/meminfo: memFree=20047300/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=1034016 CPUtime=1062.31 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 188695 0 0 0 106164 67 0 0 25 0 1 0 598365575 1058832384 28287 33554432000 4194304 4587354 140736259423104 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 258504 28287 336 96 0 255066 0
[pid=1335] ppid=1333 vsize=213636 CPUtime=1062.25 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 52344 0 0 0 106211 14 0 0 25 0 1 0 598365575 218763264 49223 33554432000 4194304 4785740 140733772797760 18446744073709551615 4538880 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 53409 49223 340 145 0 50454 0
[pid=1337] ppid=1333 vsize=51052 CPUtime=1062.28 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 50087 0 0 0 106219 9 0 0 25 0 1 0 598365575 52277248 11931 33554432000 4194304 4352236 140733587078176 18446744073709551615 4209664 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 12763 11931 127 39 0 11843 0
[pid=1338] ppid=1333 vsize=178188 CPUtime=1056.5 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 91213 0 0 0 105637 13 0 0 25 0 1 0 598365575 182464512 24745 33554432000 4194304 4331988 140737150192224 18446744073709551615 4263152 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 44547 24745 175 34 0 42989 0
Current children cumulated CPU time (s) 4243.35
Current children cumulated vsize (KiB) 1495216

[startup+1122.3 s]
/proc/loadavg: 9.13 8.89 8.56 10/187 1443
/proc/meminfo: memFree=20022352/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=991424 CPUtime=1122.32 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 195794 0 0 0 112161 71 0 0 25 0 1 0 598365575 1015218176 28257 33554432000 4194304 4587354 140736259423104 18446744073709551615 4241312 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 247856 28257 336 96 0 244418 0
[pid=1335] ppid=1333 vsize=227312 CPUtime=1122.26 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 55660 0 0 0 112211 15 0 0 25 0 1 0 598365575 232767488 52539 33554432000 4194304 4785740 140733772797760 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 56828 52539 340 145 0 53873 0
[pid=1337] ppid=1333 vsize=53100 CPUtime=1122.28 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 51111 0 0 0 112219 9 0 0 25 0 1 0 598365575 54374400 12443 33554432000 4194304 4352236 140733587078176 18446744073709551615 4278667 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 13275 12443 127 39 0 12355 0
[pid=1338] ppid=1333 vsize=178188 CPUtime=1116.18 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 91249 0 0 0 111604 14 0 0 25 0 1 0 598365575 182464512 24781 33554432000 4194304 4331988 140737150192224 18446744073709551615 4263331 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 44547 24781 175 34 0 42989 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 1468348

[startup+1182.3 s]
/proc/loadavg: 9.13 8.93 8.59 10/187 1444
/proc/meminfo: memFree=19965764/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=1017516 CPUtime=1182.32 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 202484 0 0 0 118159 73 0 0 25 0 1 0 598365575 1041936384 28015 33554432000 4194304 4587354 140736259423104 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 254379 28015 336 96 0 250941 0
[pid=1335] ppid=1333 vsize=232364 CPUtime=1182.26 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 56877 0 0 0 118211 15 0 0 25 0 1 0 598365575 237940736 53756 33554432000 4194304 4785740 140733772797760 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 58091 53756 340 145 0 55136 0
[pid=1337] ppid=1333 vsize=52076 CPUtime=1182.28 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 51623 0 0 0 118218 10 0 0 25 0 1 0 598365575 53325824 12187 33554432000 4194304 4352236 140733587078176 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 13019 12187 127 39 0 12099 0
[pid=1338] ppid=1333 vsize=178188 CPUtime=1175.86 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 91284 0 0 0 117572 14 0 0 25 0 1 0 598365575 182464512 24816 33554432000 4194304 4331988 140737150192224 18446744073709551615 4263258 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 44547 24816 175 34 0 42989 0
Current children cumulated CPU time (s) 4722.73
Current children cumulated vsize (KiB) 1498468



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 9.09 8.94 8.60 10/187 1445
/proc/meminfo: memFree=19957072/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=1035568 CPUtime=1201.73 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 207089 0 0 0 120098 75 0 0 25 0 1 0 598365575 1060421632 31708 33554432000 4194304 4587354 140736259423104 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 258892 31708 336 96 0 255454 0
[pid=1335] ppid=1333 vsize=232364 CPUtime=1201.66 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 56879 0 0 0 120151 15 0 0 25 0 1 0 598365575 237940736 53758 33554432000 4194304 4785740 140733772797760 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 58091 53758 340 145 0 55136 0
[pid=1337] ppid=1333 vsize=53100 CPUtime=1201.68 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 51879 0 0 0 120158 10 0 0 25 0 1 0 598365575 54374400 12443 33554432000 4194304 4352236 140733587078176 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 13275 12443 127 39 0 12355 0
[pid=1338] ppid=1333 vsize=178188 CPUtime=1195.15 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 91295 0 0 0 119501 14 0 0 25 0 1 0 598365575 182464512 24827 33554432000 4194304 4331988 140737150192224 18446744073709551615 231895186970 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 44547 24827 175 34 0 42989 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 1517544

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 9.09 8.94 8.60 10/187 1445
/proc/meminfo: memFree=19957072/32950928 swapFree=67111524/67111528
[pid=1333] ppid=1331 vsize=18324 CPUtime=0.01 cores=0,2,4,6
/proc/1333/stat : 1333 (ppfolio) S 1331 1333 567 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 598365575 18763776 391 33554432000 4194304 4287625 140735856674800 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639363 0 0 17 4 0 0 0
/proc/1333/statm: 4581 391 342 23 0 91 0
[pid=1334] ppid=1333 vsize=1035568 CPUtime=1201.73 cores=0
/proc/1334/stat : 1334 (cryptominisat) R 1333 1333 567 0 -1 4202496 207089 0 0 0 120098 75 0 0 25 0 1 0 598365575 1060421632 31708 33554432000 4194304 4587354 140736259423104 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1334/statm: 258892 31708 336 96 0 255454 0
[pid=1335] ppid=1333 vsize=232364 CPUtime=1201.66 cores=4
/proc/1335/stat : 1335 (clasp) R 1333 1333 567 0 -1 4202496 56879 0 0 0 120151 15 0 0 25 0 1 0 598365575 237940736 53758 33554432000 4194304 4785740 140733772797760 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/1335/statm: 58091 53758 340 145 0 55136 0
[pid=1337] ppid=1333 vsize=53100 CPUtime=1201.68 cores=2
/proc/1337/stat : 1337 (lingeling) R 1333 1333 567 0 -1 4202496 51879 0 0 0 120158 10 0 0 25 0 1 0 598365575 54374400 12443 33554432000 4194304 4352236 140733587078176 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/1337/statm: 13275 12443 127 39 0 12355 0
[pid=1338] ppid=1333 vsize=178188 CPUtime=1195.15 cores=6
/proc/1338/stat : 1338 (march_hi) R 1333 1333 567 0 -1 4202496 91295 0 0 0 119501 14 0 0 25 0 1 0 598365575 182464512 24827 33554432000 4194304 4331988 140737150192224 18446744073709551615 231895186970 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/1338/statm: 44547 24827 175 34 0 42989 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 1517544

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1333 and gives
#  childrusage.ru_utime.tv_sec=1201
#  childrusage.ru_utime.tv_usec=598329
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=124981
# CPU time returned by wait4() is 1201.72
# while last known CPU time is 4800.23
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.23
CPU user time (s): 4799.08
CPU system time (s): 1.15
CPU usage (%): 399.449
Max. virtual memory (cumulated for all children) (KiB): 2380712

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1201.6
system time used= 0.124981
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 53601
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 312
involuntary context switches= 2744

runsolver used 1.86072 second user time and 4.70228 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 14:49:09
IDJOB=3289398
IDBENCH=83121
IDSOLVER=1612
FILE ID=node114/3289398-1304081349
RUNJOBID= node114-1304077601-585
PBS_JOBID= 13170509
Free space on /tmp= 71784 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top25.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289398-1304081349/watcher-3289398-1304081349 -o /tmp/evaluation-result-3289398-1304081349/solver-3289398-1304081349 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3289398-1304081349.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1d36146d5d79c91e0605a19242395228
RANDOM SEED=1907934884

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20315616 kB
Buffers:       2222400 kB
Cached:        9359980 kB
SwapCached:          4 kB
Active:        3252684 kB
Inactive:      8802416 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20315616 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           13632 kB
Writeback:           0 kB
AnonPages:      472156 kB
Mapped:          16340 kB
Slab:           515904 kB
PageTables:       6172 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   694972 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71776 MiB
End job on node114 at 2011-04-29 15:09:13