Trace number 3284017

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.01 1300.03

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_19_UNKNOWN.cnf
MD5SUM4cf2a693df1b6e5a084b88e84ec5f2af
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark14.5608
Satisfiable
(Un)Satisfiability was proved
Number of variables4020
Number of clauses466486
Sum of the clauses size1393798
Maximum clause length20
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 26187
Number of clauses of size 3460268
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 0
0.00/0.00	Starting TNM 2009 on core(s) 0

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3284017-1303758824/watcher-3284017-1303758824 -o /tmp/evaluation-result-3284017-1303758824/solver-3284017-1303758824 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3284017-1303758824.cnf 

running on 2 cores: 0,2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.32 9.25 9.71 8/187 29308
/proc/meminfo: memFree=18182796/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) R 29306 29308 28714 0 -1 4202496 483 0 0 0 0 0 0 0 25 0 1 0 487482099 18763776 391 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664628629 0 0 4096 65536 0 0 0 17 0 0 0 0
/proc/29308/statm: 4581 391 343 23 0 91 0

[startup+0.0447379 s]
/proc/loadavg: 9.32 9.25 9.71 8/187 29308
/proc/meminfo: memFree=18182796/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 497 0 0 0 0 0 0 0 25 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4512161528710922497 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100759 s]
/proc/loadavg: 9.32 9.25 9.71 8/187 29308
/proc/meminfo: memFree=18182796/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 497 0 0 0 0 0 0 0 25 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4512161528710922497 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300721 s]
/proc/loadavg: 9.32 9.25 9.71 8/187 29308
/proc/meminfo: memFree=18182796/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 23 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700657 s]
/proc/loadavg: 9.32 9.25 9.71 8/187 29308
/proc/meminfo: memFree=18182796/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 23 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50053 s]
/proc/loadavg: 9.32 9.25 9.71 10/191 29312
/proc/meminfo: memFree=18077856/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 23 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=82360 CPUtime=0.54 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 9267 0 0 0 52 2 0 0 25 0 1 0 487482100 84336640 8703 33554432000 4194304 4587354 140736136152496 18446744073709551615 4238246 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 20590 8703 306 96 0 17152 0
[pid=29310] ppid=29308 vsize=49396 CPUtime=0.41 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 11589 0 0 0 41 0 0 0 25 0 1 0 487482100 50581504 9685 33554432000 4194304 4785740 140735668931616 18446744073709551615 4495227 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 12349 9685 314 145 0 9394 0
[pid=29311] ppid=29308 vsize=482764 CPUtime=0.51 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 9802 0 0 0 50 1 0 0 25 0 1 0 487482100 494350336 9699 33554432000 134512640 134534564 4293650304 18446744073709551615 134524491 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 120691 9699 91 6 0 119357 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 632844

[startup+3.10124 s]
/proc/loadavg: 9.32 9.25 9.71 10/191 29312
/proc/meminfo: memFree=18033092/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807347411125010432 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=125272 CPUtime=1.04 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 21857 0 0 0 101 3 0 0 25 0 1 0 487482100 128278528 19216 33554432000 4194304 4587354 140736136152496 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 31318 19216 316 96 0 27880 0
[pid=29310] ppid=29308 vsize=49396 CPUtime=0.92 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 11589 0 0 0 92 0 0 0 25 0 1 0 487482100 50581504 9685 33554432000 4194304 4785740 140735668931616 18446744073709551615 4495669 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 12349 9685 314 145 0 9394 0
[pid=29311] ppid=29308 vsize=482764 CPUtime=1.1 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 9802 0 0 0 109 1 0 0 25 0 1 0 487482100 494350336 9699 33554432000 134512640 134534564 4293650304 18446744073709551615 134524548 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 120691 9699 91 6 0 119357 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 675756

[startup+6.30068 s]
/proc/loadavg: 9.29 9.25 9.70 10/191 29312
/proc/meminfo: memFree=18006436/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807347411125010432 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=126236 CPUtime=2.14 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 26720 0 0 0 210 4 0 0 25 0 1 0 487482100 129265664 19572 33554432000 4194304 4587354 140736136152496 18446744073709551615 4365209 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 31559 19572 317 96 0 28121 0
[pid=29310] ppid=29308 vsize=49396 CPUtime=2.01 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 11589 0 0 0 201 0 0 0 25 0 1 0 487482100 50581504 9685 33554432000 4194304 4785740 140735668931616 18446744073709551615 4495691 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 12349 9685 314 145 0 9394 0
[pid=29311] ppid=29308 vsize=482764 CPUtime=2.11 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 9802 0 0 0 210 1 0 0 25 0 1 0 487482100 494350336 9699 33554432000 134512640 134534564 4293650304 18446744073709551615 134524582 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 120691 9699 91 6 0 119357 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 676720

[startup+12.7006 s]
/proc/loadavg: 9.43 9.28 9.71 10/191 29312
/proc/meminfo: memFree=17988360/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=156352 CPUtime=4.24 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 36351 0 0 0 419 5 0 0 25 0 1 0 487482100 160104448 26023 33554432000 4194304 4587354 140736136152496 18446744073709551615 4238240 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 39088 26023 326 96 0 35650 0
[pid=29310] ppid=29308 vsize=51260 CPUtime=4.12 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 12038 0 0 0 412 0 0 0 25 0 1 0 487482100 52490240 10134 33554432000 4194304 4785740 140735668931616 18446744073709551615 4482776 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 12815 10134 316 145 0 9860 0
[pid=29311] ppid=29308 vsize=482764 CPUtime=4.3 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 9802 0 0 0 429 1 0 0 25 0 1 0 487482100 494350336 9699 33554432000 134512640 134534564 4293650304 18446744073709551615 134524573 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 120691 9699 91 6 0 119357 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 708700

[startup+25.5004 s]
/proc/loadavg: 9.33 9.26 9.70 10/191 29313
/proc/meminfo: memFree=17941168/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807348235758731264 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=156352 CPUtime=8.54 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 38747 0 0 0 848 6 0 0 25 0 1 0 487482100 160104448 28408 33554432000 4194304 4587354 140736136152496 18446744073709551615 4238944 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 39088 28408 327 96 0 35650 0
[pid=29310] ppid=29308 vsize=55828 CPUtime=8.41 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 13185 0 0 0 840 1 0 0 25 0 1 0 487482100 57167872 11281 33554432000 4194304 4785740 140735668931616 18446744073709551615 4482895 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 13957 11281 316 145 0 11002 0
[pid=29311] ppid=29308 vsize=482764 CPUtime=8.52 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 9802 0 0 0 851 1 0 0 25 0 1 0 487482100 494350336 9699 33554432000 134512640 134534564 4293650304 18446744073709551615 134524464 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 120691 9699 91 6 0 119357 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 713268

[startup+51.1009 s]
/proc/loadavg: 9.22 9.24 9.68 10/191 29313
/proc/meminfo: memFree=17919568/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807347960880824320 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=179052 CPUtime=17.04 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 47724 0 0 0 1696 8 0 0 25 0 1 0 487482100 183349248 37371 33554432000 4194304 4587354 140736136152496 18446744073709551615 4365152 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 44763 37371 337 96 0 41325 0
[pid=29310] ppid=29308 vsize=61620 CPUtime=16.93 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 15521 0 0 0 1691 2 0 0 25 0 1 0 487482100 63098880 12705 33554432000 4194304 4785740 140735668931616 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 15405 12705 340 145 0 12450 0
[pid=29311] ppid=29308 vsize=482764 CPUtime=17.1 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 9802 0 0 0 1709 1 0 0 25 0 1 0 487482100 494350336 9699 33554432000 134512640 134534564 4293650304 18446744073709551615 134524491 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 120691 9699 91 6 0 119357 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 741760

[startup+102.307 s]
/proc/loadavg: 9.09 9.20 9.64 10/191 29315
/proc/meminfo: memFree=17807828/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807348098319777792 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=209952 CPUtime=34.14 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 63591 0 0 0 3404 10 0 0 25 0 1 0 487482100 214990848 44272 33554432000 4194304 4587354 140736136152496 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 52488 44272 337 96 0 49050 0
[pid=29310] ppid=29308 vsize=93932 CPUtime=34.01 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 23389 0 0 0 3398 3 0 0 25 0 1 0 487482100 96186368 20573 33554432000 4194304 4785740 140735668931616 18446744073709551615 4304083 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 23483 20573 340 145 0 20528 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=34.13 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 3412 1 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 807744

[startup+162.301 s]
/proc/loadavg: 9.07 9.18 9.60 10/191 29316
/proc/meminfo: memFree=17800756/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=142724 CPUtime=54.13 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 68293 0 0 0 5402 11 0 0 25 0 1 0 487482100 146149376 29372 33554432000 4194304 4587354 140736136152496 18446744073709551615 4239240 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 35681 29372 337 96 0 32243 0
[pid=29310] ppid=29308 vsize=133036 CPUtime=54.01 cores=0

################
# More data... #
################

/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 822.28
Current children cumulated vsize (KiB) 1705656

[startup+882.301 s]
/proc/loadavg: 9.00 9.01 9.26 10/191 29335
/proc/meminfo: memFree=17673060/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=791720 CPUtime=294.1 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 281406 0 0 0 29359 51 0 0 25 0 1 0 487482100 810721280 29040 33554432000 4194304 4587354 140736136152496 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 197930 29040 337 96 0 194492 0
[pid=29310] ppid=29308 vsize=256148 CPUtime=294.03 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 62166 0 0 0 29387 16 0 0 25 0 1 0 487482100 262295552 59350 33554432000 4194304 4785740 140735668931616 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 64037 59350 340 145 0 61082 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=294.16 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 29414 2 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134528288 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 1551728

[startup+942.3 s]
/proc/loadavg: 9.07 9.02 9.24 10/191 29337
/proc/meminfo: memFree=17662140/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807347823441870848 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=791672 CPUtime=314.1 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 299978 0 0 0 31356 54 0 0 25 0 1 0 487482100 810672128 28265 33554432000 4194304 4587354 140736136152496 18446744073709551615 4238522 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 197918 28265 337 96 0 194480 0
[pid=29310] ppid=29308 vsize=268524 CPUtime=314.03 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 65113 0 0 0 31387 16 0 0 25 0 1 0 487482100 274968576 62297 33554432000 4194304 4785740 140735668931616 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 67131 62297 340 145 0 64176 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=314.16 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 31414 2 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134530606 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 942.29
Current children cumulated vsize (KiB) 1564056

[startup+1002.3 s]
/proc/loadavg: 9.02 9.01 9.23 7/186 29340
/proc/meminfo: memFree=17746616/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807348098319777792 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=792752 CPUtime=334.09 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 312402 0 0 0 33352 57 0 0 25 0 1 0 487482100 811778048 30606 33554432000 4194304 4587354 140736136152496 18446744073709551615 4241092 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 198188 30606 337 96 0 194750 0
[pid=29310] ppid=29308 vsize=271604 CPUtime=334.04 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 65861 0 0 0 33388 16 0 0 25 0 1 0 487482100 278122496 63045 33554432000 4194304 4785740 140735668931616 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 67901 63045 340 145 0 64946 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=334.15 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 33413 2 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 1002.28
Current children cumulated vsize (KiB) 1568216

[startup+1062.3 s]
/proc/loadavg: 7.11 8.46 9.02 7/182 29358
/proc/meminfo: memFree=17645944/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807347411125010432 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=912196 CPUtime=354.09 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 350171 0 0 0 35346 63 0 0 25 0 1 0 487482100 934088704 58279 33554432000 4194304 4587354 140736136152496 18446744073709551615 4388338 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 228049 58279 337 96 0 224611 0
[pid=29310] ppid=29308 vsize=275920 CPUtime=354.06 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 66859 0 0 0 35389 17 0 0 25 0 1 0 487482100 282542080 64043 33554432000 4194304 4785740 140735668931616 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 68980 64043 340 145 0 66025 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=354.15 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 35413 2 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134530606 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 1691976

[startup+1122.3 s]
/proc/loadavg: 6.41 8.01 8.83 7/182 29360
/proc/meminfo: memFree=17747236/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=792824 CPUtime=374.09 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 355637 0 0 0 37345 64 0 0 25 0 1 0 487482100 811851776 30331 33554432000 4194304 4587354 140736136152496 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 198206 30331 337 96 0 194768 0
[pid=29310] ppid=29308 vsize=281788 CPUtime=374.06 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 68258 0 0 0 37389 17 0 0 25 0 1 0 487482100 288550912 65442 33554432000 4194304 4785740 140735668931616 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 70447 65442 340 145 0 67492 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=374.15 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 37412 3 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 1122.3
Current children cumulated vsize (KiB) 1578472

[startup+1182.3 s]
/proc/loadavg: 6.15 7.64 8.65 7/182 29361
/proc/meminfo: memFree=17751696/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807348098319777792 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=794052 CPUtime=394.1 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 373963 0 0 0 39343 67 0 0 25 0 1 0 487482100 813109248 28250 33554432000 4194304 4587354 140736136152496 18446744073709551615 4238271 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 198513 28250 337 96 0 195075 0
[pid=29310] ppid=29308 vsize=286588 CPUtime=394.05 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 69262 0 0 0 39388 17 0 0 25 0 1 0 487482100 293466112 66446 33554432000 4194304 4785740 140735668931616 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 71647 66446 340 145 0 68692 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=394.15 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 39412 3 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134528966 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 1182.3
Current children cumulated vsize (KiB) 1584500

[startup+1242.3 s]
/proc/loadavg: 6.05 7.34 8.48 7/182 29363
/proc/meminfo: memFree=17735436/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807348373197684736 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=793532 CPUtime=414.1 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 386954 0 0 0 41341 69 0 0 25 0 1 0 487482100 812576768 30854 33554432000 4194304 4587354 140736136152496 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 198383 30854 337 96 0 194945 0
[pid=29310] ppid=29308 vsize=292988 CPUtime=414.05 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 70678 0 0 0 41388 17 0 0 25 0 1 0 487482100 300019712 67862 33554432000 4194304 4785740 140735668931616 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 73247 67862 340 145 0 70292 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=414.14 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 41411 3 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134529651 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 1242.29
Current children cumulated vsize (KiB) 1590380



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 5.16 6.90 8.26 4/173 29383
/proc/meminfo: memFree=17912076/32951132 swapFree=67111528/67111528
[pid=29308] ppid=29306 vsize=18324 CPUtime=0 cores=0,2
/proc/29308/stat : 29308 (ppfolio) S 29306 29308 28714 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 487482099 18763776 393 33554432000 4194304 4287625 140736120773760 18446744073709551615 274664828431 0 0 4096 65536 4807348510636638208 0 0 17 2 0 0 0
/proc/29308/statm: 4581 393 345 23 0 91 0
[pid=29309] ppid=29308 vsize=793672 CPUtime=433.38 cores=0
/proc/29309/stat : 29309 (cryptominisat) R 29308 29308 28714 0 -1 4202496 405741 0 0 0 43264 74 0 0 25 0 1 0 487482100 812720128 27523 33554432000 4194304 4587354 140736136152496 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29309/statm: 198418 27523 337 96 0 194980 0
[pid=29310] ppid=29308 vsize=299388 CPUtime=433.25 cores=0
/proc/29310/stat : 29310 (clasp) R 29308 29308 28714 0 -1 4202496 72137 0 0 0 43307 18 0 0 25 0 1 0 487482100 306573312 69321 33554432000 4194304 4785740 140735668931616 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/29310/statm: 74847 69321 340 145 0 71892 0
[pid=29311] ppid=29308 vsize=485536 CPUtime=433.38 cores=0
/proc/29311/stat : 29311 (TNM) R 29308 29308 28714 0 -1 4202496 12879 0 0 0 43335 3 0 0 25 0 1 0 487482100 497188864 12776 33554432000 134512640 134534564 4293650304 18446744073709551615 134530614 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/29311/statm: 121384 12776 95 6 0 120050 0
Current children cumulated CPU time (s) 1300.01
Current children cumulated vsize (KiB) 1596920

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29308 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.001999
# while last known CPU time is 1300.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.03
CPU time (s): 1300.01
CPU user time (s): 1299.06
CPU system time (s): 0.95
CPU usage (%): 99.9983
Max. virtual memory (cumulated for all children) (KiB): 2288440

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 499
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 152
involuntary context switches= 4

runsolver used 2.27065 second user time and 4.82127 second system time

The end

Launcher Data 

Begin job on node131 at 2011-04-25 21:13:45
IDJOB=3284017
IDBENCH=71095
IDSOLVER=1613
FILE ID=node131/3284017-1303758824
RUNJOBID= node131-1303756167-28732
PBS_JOBID= 13154069
Free space on /tmp= 72028 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_19_UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3284017-1303758824/watcher-3284017-1303758824 -o /tmp/evaluation-result-3284017-1303758824/solver-3284017-1303758824 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3284017-1303758824.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 4cf2a693df1b6e5a084b88e84ec5f2af
RANDOM SEED=799736077

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      18182952 kB
Buffers:       1003256 kB
Cached:       13038548 kB
SwapCached:          0 kB
Active:        4659776 kB
Inactive:      9591544 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      18182952 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           29544 kB
Writeback:           0 kB
AnonPages:      208828 kB
Mapped:          17668 kB
Slab:           452804 kB
PageTables:       5620 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:  1555616 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72040 MiB
End job on node131 at 2011-04-25 21:35:27