Trace number 3265210

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.02 1300.03

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
harder/php-040-039.shuffled-as.sat05-1194.cnf
MD5SUM8c84d9b9f2d75de33656119bc03a9afb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark45.3841
Satisfiable
(Un)Satisfiability was proved
Number of variables1560
Number of clauses30460
Sum of the clauses size62400
Maximum clause length39
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 230420
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 4
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 4

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265210-1303562304/watcher-3265210-1303562304 -o /tmp/evaluation-result-3265210-1303562304/solver-3265210-1303562304 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3265210-1303562304.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21124
/proc/meminfo: memFree=26062520/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) R 21122 21124 20580 0 -1 4202496 485 0 0 0 0 0 0 0 23 0 1 0 546461116 18763776 392 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905214357 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/21124/statm: 4581 392 343 23 0 91 0

[startup+0.0212631 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21124
/proc/meminfo: memFree=26062520/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 500 0 0 0 0 0 0 0 23 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 3995063684069032196 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100248 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21124
/proc/meminfo: memFree=26062520/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 500 0 0 0 0 0 0 0 23 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 3995063684069032196 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300212 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21124
/proc/meminfo: memFree=26062520/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 22 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700137 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21124
/proc/meminfo: memFree=26062520/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 22 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50099 s]
/proc/loadavg: 3.38 3.87 3.89 13/202 21141
/proc/meminfo: memFree=26015048/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 22 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=1902464 CPUtime=0.49 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 3724 0 0 0 49 0 0 0 25 0 1 0 546461116 1948123136 2355 33554432000 4194304 4587354 140734256597680 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 475616 2355 327 96 0 472178 0
[pid=21126] ppid=21124 vsize=20424 CPUtime=0.44 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 2728 0 0 0 44 0 0 0 25 0 1 0 546461116 20914176 2456 33554432000 4194304 4785740 140737368660576 18446744073709551615 260905054917 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 5106 2456 340 145 0 2151 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=0.54 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 54 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530464 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 2398884

[startup+3.10076 s]
/proc/loadavg: 3.38 3.87 3.89 13/202 21141
/proc/meminfo: memFree=25999176/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 22 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=1902464 CPUtime=0.99 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 4156 0 0 0 99 0 0 0 25 0 1 0 546461116 1948123136 2785 33554432000 4194304 4587354 140734256597680 18446744073709551615 4236883 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 475616 2785 327 96 0 472178 0
[pid=21126] ppid=21124 vsize=25592 CPUtime=0.99 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 4012 0 0 0 99 0 0 0 25 0 1 0 546461116 26206208 3740 33554432000 4194304 4785740 140737368660576 18446744073709551615 4278544 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 6398 3740 340 145 0 3443 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=1.09 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 109 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530464 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 2404052

[startup+6.30111 s]
/proc/loadavg: 4.15 4.02 3.94 13/202 21201
/proc/meminfo: memFree=25970204/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 22 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=1912396 CPUtime=2.09 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 5554 0 0 0 209 0 0 0 25 0 1 0 546461116 1958293504 2650 33554432000 4194304 4587354 140734256597680 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 478099 2650 327 96 0 474661 0
[pid=21126] ppid=21124 vsize=29980 CPUtime=2.04 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 5111 0 0 0 204 0 0 0 25 0 1 0 546461116 30699520 4839 33554432000 4194304 4785740 140737368660576 18446744073709551615 4276904 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 7495 4839 340 145 0 4540 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=2.14 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 214 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530158 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 2418372

[startup+12.7009 s]
/proc/loadavg: 4.78 4.15 3.98 13/202 21201
/proc/meminfo: memFree=25890272/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036233655725588480 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=35312 CPUtime=4.19 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 10573 0 0 0 419 0 0 0 25 0 1 0 546461116 36159488 3668 33554432000 4194304 4587354 140734256597680 18446744073709551615 4364904 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 8828 3668 337 96 0 5390 0
[pid=21126] ppid=21124 vsize=41628 CPUtime=4.19 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 7995 0 0 0 419 0 0 0 25 0 1 0 546461116 42627072 7723 33554432000 4194304 4785740 140737368660576 18446744073709551615 4287011 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 10407 7723 340 145 0 7452 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=4.29 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 429 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 552936

[startup+25.5007 s]
/proc/loadavg: 6.38 4.54 4.11 13/202 21204
/proc/meminfo: memFree=25801140/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036232693652914176 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=1942356 CPUtime=8.49 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 21773 0 0 0 847 2 0 0 25 0 1 0 546461116 1988972544 12275 33554432000 4194304 4587354 140734256597680 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 485589 12275 337 96 0 482151 0
[pid=21126] ppid=21124 vsize=54740 CPUtime=8.44 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 11222 0 0 0 843 1 0 0 25 0 1 0 546461116 56053760 10950 33554432000 4194304 4785740 140737368660576 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 13685 10950 340 145 0 10730 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=8.54 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 854 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 2473092

[startup+51.1009 s]
/proc/loadavg: 8.35 5.15 4.32 13/202 21205
/proc/meminfo: memFree=25717080/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=1944848 CPUtime=16.99 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 28241 0 0 0 1696 3 0 0 25 0 1 0 546461116 1991524352 13121 33554432000 4194304 4587354 140734256597680 18446744073709551615 4238600 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 486212 13121 337 96 0 482774 0
[pid=21126] ppid=21124 vsize=63096 CPUtime=16.99 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 13313 0 0 0 1698 1 0 0 25 0 1 0 546461116 64610304 13041 33554432000 4194304 4785740 140737368660576 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 15774 13041 340 145 0 12819 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=17.09 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 1709 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 2483940

[startup+102.308 s]
/proc/loadavg: 10.49 6.22 4.73 13/202 21207
/proc/meminfo: memFree=25541092/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036233243408728064 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=1980000 CPUtime=34.09 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 40280 0 0 0 3403 6 0 0 25 0 1 0 546461116 2027520000 21378 33554432000 4194304 4587354 140734256597680 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 495000 21378 337 96 0 491562 0
[pid=21126] ppid=21124 vsize=81076 CPUtime=34.06 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 17664 0 0 0 3404 2 0 0 25 0 1 0 546461116 83021824 17392 33554432000 4194304 4785740 140737368660576 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 20269 17392 340 145 0 17314 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=34.14 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 3414 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134528902 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 2537072

[startup+162.301 s]
/proc/loadavg: 11.44 7.27 5.18 13/202 21208
/proc/meminfo: memFree=25395348/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036232693652914176 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2007720 CPUtime=54.09 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 49264 0 0 0 5402 7 0 0 25 0 1 0 546461116 2055905280 28766 33554432000 4194304 4587354 140734256597680 18446744073709551615 4356775 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 501930 28766 337 96 0 498492 0
[pid=21126] ppid=21124 vsize=98548 CPUtime=54.06 cores=4

################
# More data... #
################

/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 2972420

[startup+882.301 s]
/proc/loadavg: 12.06 11.60 8.85 13/202 21228
/proc/meminfo: memFree=24701040/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036232693652914176 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2195584 CPUtime=294.05 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 180549 0 0 0 29373 32 0 0 25 0 1 0 546461116 2248278016 75585 33554432000 4194304 4587354 140734256597680 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 548896 75585 337 96 0 545458 0
[pid=21126] ppid=21124 vsize=158080 CPUtime=294.05 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 36122 0 0 0 29400 5 0 0 25 0 1 0 546461116 161873920 35850 33554432000 4194304 4785740 140737368660576 18446744073709551615 4278595 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 39520 35850 340 145 0 36565 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=294.2 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 29420 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 2829660

[startup+942.301 s]
/proc/loadavg: 12.02 11.67 9.05 13/202 21229
/proc/meminfo: memFree=24705224/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036232693652914176 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2204372 CPUtime=314.06 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 182230 0 0 0 31374 32 0 0 25 0 1 0 546461116 2257276928 77266 33554432000 4194304 4587354 140734256597680 18446744073709551615 4364768 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 551093 77266 337 96 0 547655 0
[pid=21126] ppid=21124 vsize=159792 CPUtime=314.04 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 36567 0 0 0 31399 5 0 0 25 0 1 0 546461116 163627008 36295 33554432000 4194304 4785740 140737368660576 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 39948 36295 340 145 0 36993 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=314.19 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 31419 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 942.29
Current children cumulated vsize (KiB) 2840160

[startup+1002.3 s]
/proc/loadavg: 12.04 11.74 9.23 13/202 21231
/proc/meminfo: memFree=24722304/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2204372 CPUtime=334.07 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 183068 0 0 0 33375 32 0 0 25 0 1 0 546461116 2257276928 78099 33554432000 4194304 4587354 140734256597680 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 551093 78099 337 96 0 547655 0
[pid=21126] ppid=21124 vsize=168724 CPUtime=334.04 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 38678 0 0 0 33399 5 0 0 25 0 1 0 546461116 172773376 38406 33554432000 4194304 4785740 140737368660576 18446744073709551615 260905091718 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 42181 38406 340 145 0 39226 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=334.19 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 33419 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 2849092

[startup+1062.3 s]
/proc/loadavg: 12.01 11.79 9.40 13/202 21232
/proc/meminfo: memFree=24628880/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2204464 CPUtime=354.08 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 193925 0 0 0 35373 35 0 0 25 0 1 0 546461116 2257371136 79415 33554432000 4194304 4587354 140734256597680 18446744073709551615 260905090712 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 551116 79415 337 96 0 547678 0
[pid=21126] ppid=21124 vsize=177000 CPUtime=354.04 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 40655 0 0 0 35398 6 0 0 25 0 1 0 546461116 181248000 40383 33554432000 4194304 4785740 140737368660576 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 44250 40383 340 145 0 41295 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=354.19 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 35419 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 2857460

[startup+1122.3 s]
/proc/loadavg: 12.00 11.82 9.56 13/202 21234
/proc/meminfo: memFree=24482388/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036233518286635008 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2203832 CPUtime=374.08 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 206938 0 0 0 37369 39 0 0 25 0 1 0 546461116 2256723968 76970 33554432000 4194304 4587354 140734256597680 18446744073709551615 260905090708 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 550958 76970 337 96 0 547520 0
[pid=21126] ppid=21124 vsize=177456 CPUtime=374.04 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 40748 0 0 0 37398 6 0 0 25 0 1 0 546461116 181714944 40476 33554432000 4194304 4785740 140737368660576 18446744073709551615 4304043 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 44364 40476 340 145 0 41409 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=374.19 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 37419 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530996 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 2857284

[startup+1182.3 s]
/proc/loadavg: 12.00 11.85 9.71 13/202 21236
/proc/meminfo: memFree=24514820/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036233793164541952 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2204688 CPUtime=394.1 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 223584 0 0 0 39365 45 0 0 25 0 1 0 546461116 2257600512 77136 33554432000 4194304 4587354 140734256597680 18446744073709551615 4238595 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 551172 77136 337 96 0 547734 0
[pid=21126] ppid=21124 vsize=180340 CPUtime=394.03 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 41446 0 0 0 39397 6 0 0 25 0 1 0 546461116 184668160 41174 33554432000 4194304 4785740 140737368660576 18446744073709551615 4278600 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 45085 41174 340 145 0 42130 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=394.18 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 39418 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134529833 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 2861024

[startup+1242.3 s]
/proc/loadavg: 12.05 11.89 9.86 13/202 21237
/proc/meminfo: memFree=24305976/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036233930603495424 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2208800 CPUtime=414.1 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 241849 0 0 0 41361 49 0 0 25 0 1 0 546461116 2261811200 77336 33554432000 4194304 4587354 140734256597680 18446744073709551615 4238595 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 552200 77337 337 96 0 548762 0
[pid=21126] ppid=21124 vsize=180712 CPUtime=414.03 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 41536 0 0 0 41397 6 0 0 25 0 1 0 546461116 185049088 41264 33554432000 4194304 4785740 140737368660576 18446744073709551615 4278573 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 45178 41264 340 145 0 42223 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=414.18 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 41418 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134530619 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 2865508



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.09 11.92 10.00 10/197 21240
/proc/meminfo: memFree=24853560/32950928 swapFree=67071984/67111528
[pid=21124] ppid=21122 vsize=18324 CPUtime=0 cores=4,6
/proc/21124/stat : 21124 (ppfolio) S 21122 21124 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461116 18763776 394 33554432000 4194304 4287625 140736558367584 18446744073709551615 260905414159 0 0 4096 65536 4036233243408728064 0 0 17 6 0 0 0
/proc/21124/statm: 4581 394 345 23 0 91 0
[pid=21125] ppid=21124 vsize=2305288 CPUtime=433.83 cores=4
/proc/21125/stat : 21125 (cryptominisat) R 21124 21124 20580 0 -1 4202496 273897 0 0 0 43329 54 0 0 25 0 1 0 546461116 2360614912 102999 33554432000 4194304 4587354 140734256597680 18446744073709551615 4357642 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/21125/statm: 576322 102999 337 96 0 572884 0
[pid=21126] ppid=21124 vsize=182840 CPUtime=433.03 cores=4
/proc/21126/stat : 21126 (clasp) R 21124 21124 20580 0 -1 4202496 42025 0 0 0 43297 6 0 0 25 0 1 0 546461116 187228160 41753 33554432000 4194304 4785740 140737368660576 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/21126/statm: 45710 41753 340 145 0 42755 0
[pid=21127] ppid=21124 vsize=457672 CPUtime=433.16 cores=4
/proc/21127/stat : 21127 (TNM) R 21124 21124 20580 0 -1 4202496 1059 0 0 0 43316 0 0 0 25 0 1 0 546461116 468656128 956 33554432000 134512640 134534564 4291543968 18446744073709551615 134529838 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/21127/statm: 114418 956 95 6 0 113084 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 2964124

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21124 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 1300.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.03
CPU time (s): 1300.02
CPU user time (s): 1299.42
CPU system time (s): 0.6
CPU usage (%): 99.9989
Max. virtual memory (cumulated for all children) (KiB): 4972148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 501
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 204
involuntary context switches= 4

runsolver used 2.13567 second user time and 5.03024 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-23 14:38:24
IDJOB=3265210
IDBENCH=85456
IDSOLVER=1613
FILE ID=node116/3265210-1303562304
RUNJOBID= node116-1303562304-21087
PBS_JOBID= 13150279
Free space on /tmp= 72596 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/harder/php-040-039.shuffled-as.sat05-1194.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265210-1303562304/watcher-3265210-1303562304 -o /tmp/evaluation-result-3265210-1303562304/solver-3265210-1303562304 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3265210-1303562304.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 8c84d9b9f2d75de33656119bc03a9afb
RANDOM SEED=1056065165

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26064412 kB
Buffers:       1814964 kB
Cached:        4582280 kB
SwapCached:       9728 kB
Active:        2966652 kB
Inactive:      3506200 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26064412 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:           32140 kB
Writeback:           0 kB
AnonPages:       69556 kB
Mapped:          15880 kB
Slab:           350012 kB
PageTables:       5832 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1188412 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72576 MiB
End job on node116 at 2011-04-23 15:00:06