Trace number 3265254

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.02 1300.02

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
harder/php-020-019.shuffled-as.sat05-1190.cnf
MD5SUM81bbeaaf9f0ca3bfc36d743097777052
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1.62875
Satisfiable
(Un)Satisfiability was proved
Number of variables380
Number of clauses3630
Sum of the clauses size7600
Maximum clause length19
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23610
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 5
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 5

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265254-1303562307/watcher-3265254-1303562307 -o /tmp/evaluation-result-3265254-1303562307/solver-3265254-1303562307 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3265254-1303562307.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21184
/proc/meminfo: memFree=26039200/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) R 21182 21184 20580 0 -1 4202496 485 0 0 0 0 0 0 0 25 0 1 0 546461365 18763776 392 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905214357 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/21184/statm: 4581 392 343 23 0 91 0

[startup+0.0102299 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21184
/proc/meminfo: memFree=26039200/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 500 0 0 0 0 0 0 0 25 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4540819199777276168 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100213 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21184
/proc/meminfo: memFree=26039200/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 500 0 0 0 0 0 0 0 25 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4540819199777276168 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300177 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21184
/proc/meminfo: memFree=26039200/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 24 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700104 s]
/proc/loadavg: 3.38 3.87 3.89 7/190 21184
/proc/meminfo: memFree=26039200/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 22 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480626293980790784 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50096 s]
/proc/loadavg: 3.38 3.87 3.89 13/202 21201
/proc/meminfo: memFree=26003828/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480624369835442176 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1425536 CPUtime=0.49 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 2578 0 0 0 49 0 0 0 25 0 1 0 546461365 1459748864 1010 33554432000 4194304 4587354 140734638447360 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 356384 1010 326 96 0 352946 0
[pid=21186] ppid=21184 vsize=14556 CPUtime=0.4 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 1094 0 0 0 40 0 0 0 25 0 1 0 546461365 14905344 985 33554432000 4194304 4785740 140736656180816 18446744073709551615 4416837 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 3639 985 340 145 0 684 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=0.59 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 59 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134529841 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 1914372

[startup+3.10066 s]
/proc/loadavg: 4.15 4.02 3.94 13/202 21201
/proc/meminfo: memFree=25993640/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480626293980790784 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1440740 CPUtime=0.99 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 7213 0 0 0 98 1 0 0 25 0 1 0 546461365 1475317760 4882 33554432000 4194304 4587354 140734638447360 18446744073709551615 4357549 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 360185 4882 336 96 0 356747 0
[pid=21186] ppid=21184 vsize=15620 CPUtime=0.94 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 1360 0 0 0 94 0 0 0 25 0 1 0 546461365 15994880 1251 33554432000 4194304 4785740 140736656180816 18446744073709551615 4553366 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 3905 1251 340 145 0 950 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=1.14 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 114 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 1930640

[startup+6.30108 s]
/proc/loadavg: 4.15 4.02 3.94 13/202 21201
/proc/meminfo: memFree=25959820/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1441908 CPUtime=2.09 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 7572 0 0 0 208 1 0 0 25 0 1 0 546461365 1476513792 5240 33554432000 4194304 4587354 140734638447360 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 360477 5240 336 96 0 357039 0
[pid=21186] ppid=21184 vsize=16720 CPUtime=2 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 1638 0 0 0 200 0 0 0 25 0 1 0 546461365 17121280 1529 33554432000 4194304 4785740 140736656180816 18446744073709551615 4287229 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 4180 1529 340 145 0 1225 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=2.19 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 219 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1932908

[startup+12.7009 s]
/proc/loadavg: 5.36 4.28 4.02 13/202 21201
/proc/meminfo: memFree=25846748/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480624644713349120 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1445160 CPUtime=4.19 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 12378 0 0 0 418 1 0 0 25 0 1 0 546461365 1479843840 5882 33554432000 4194304 4587354 140734638447360 18446744073709551615 4364768 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 361290 5882 336 96 0 357852 0
[pid=21186] ppid=21184 vsize=18120 CPUtime=4.14 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 1963 0 0 0 414 0 0 0 25 0 1 0 546461365 18554880 1854 33554432000 4194304 4785740 140736656180816 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 4530 1854 340 145 0 1575 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=4.34 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 434 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134529896 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 1937560

[startup+25.5006 s]
/proc/loadavg: 6.38 4.54 4.11 13/202 21204
/proc/meminfo: memFree=25792212/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480625331908116480 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1464816 CPUtime=8.49 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 19798 0 0 0 847 2 0 0 25 0 1 0 546461365 1499971584 10581 33554432000 4194304 4587354 140734638447360 18446744073709551615 4365236 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 366204 10581 336 96 0 362766 0
[pid=21186] ppid=21184 vsize=19720 CPUtime=8.39 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 2348 0 0 0 839 0 0 0 25 0 1 0 546461365 20193280 2239 33554432000 4194304 4785740 140736656180816 18446744073709551615 4278107 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 4930 2239 340 145 0 1975 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=8.59 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 859 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 1958816

[startup+51.1009 s]
/proc/loadavg: 8.35 5.15 4.32 13/202 21206
/proc/meminfo: memFree=25707904/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480625331908116480 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1465136 CPUtime=16.99 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 39112 0 0 0 1695 4 0 0 25 0 1 0 546461365 1500299264 11722 33554432000 4194304 4587354 140734638447360 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 366284 11722 336 96 0 362846 0
[pid=21186] ppid=21184 vsize=21872 CPUtime=16.95 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 2877 0 0 0 1695 0 0 0 25 0 1 0 546461365 22396928 2768 33554432000 4194304 4785740 140736656180816 18446744073709551615 4278129 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 5468 2768 340 145 0 2513 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=17.14 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 1714 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134528551 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1961288

[startup+102.308 s]
/proc/loadavg: 10.61 6.31 4.77 13/202 21207
/proc/meminfo: memFree=25532656/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480626156541837312 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1480020 CPUtime=34.09 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 72421 0 0 0 3399 10 0 0 25 0 1 0 546461365 1515540480 14243 33554432000 4194304 4587354 140734638447360 18446744073709551615 4238573 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 370005 14243 336 96 0 366567 0
[pid=21186] ppid=21184 vsize=24560 CPUtime=33.99 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 3468 0 0 0 3399 0 0 0 25 0 1 0 546461365 25149440 3359 33554432000 4194304 4785740 140736656180816 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 6140 3359 341 145 0 3185 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=34.21 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 3421 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134528412 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 1978860

[startup+162.301 s]
/proc/loadavg: 11.44 7.27 5.18 13/202 21208
/proc/meminfo: memFree=25407864/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1500448 CPUtime=54.08 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 104454 0 0 0 5393 15 0 0 25 0 1 0 546461365 1536458752 21150 33554432000 4194304 4587354 140734638447360 18446744073709551615 4238096 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 375112 21150 336 96 0 371674 0
[pid=21186] ppid=21184 vsize=26696 CPUtime=53.98 cores=5

################
# More data... #
################

/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 2098136

[startup+882.301 s]
/proc/loadavg: 12.06 11.61 8.87 13/202 21228
/proc/meminfo: memFree=24692108/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480624369835442176 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1584424 CPUtime=294.06 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 209091 0 0 0 29371 35 0 0 25 0 1 0 546461365 1622450176 45552 33554432000 4194304 4587354 140734638447360 18446744073709551615 4244609 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 396106 45552 336 96 0 392668 0
[pid=21186] ppid=21184 vsize=39952 CPUtime=294.05 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 6962 0 0 0 29404 1 0 0 25 0 1 0 546461365 40910848 6853 33554432000 4194304 4785740 140736656180816 18446744073709551615 4553388 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 9988 6853 341 145 0 7033 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=294.2 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 29420 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 2098656

[startup+942.301 s]
/proc/loadavg: 12.02 11.67 9.05 13/202 21229
/proc/meminfo: memFree=24711168/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480624644713349120 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1584628 CPUtime=314.06 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 217678 0 0 0 31370 36 0 0 25 0 1 0 546461365 1622659072 42976 33554432000 4194304 4587354 140734638447360 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 396157 42976 336 96 0 392719 0
[pid=21186] ppid=21184 vsize=40124 CPUtime=314.05 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 7016 0 0 0 31404 1 0 0 25 0 1 0 546461365 41086976 6907 33554432000 4194304 4785740 140736656180816 18446744073709551615 4278129 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 10031 6907 341 145 0 7076 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=314.2 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 31420 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 2099032

[startup+1002.3 s]
/proc/loadavg: 12.03 11.74 9.25 13/202 21231
/proc/meminfo: memFree=24717956/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480624919591256064 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1584212 CPUtime=334.07 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 226919 0 0 0 33369 38 0 0 25 0 1 0 546461365 1622233088 42976 33554432000 4194304 4587354 140734638447360 18446744073709551615 4237684 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 396053 42976 336 96 0 392615 0
[pid=21186] ppid=21184 vsize=40628 CPUtime=334.04 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 7102 0 0 0 33403 1 0 0 25 0 1 0 546461365 41603072 6993 33554432000 4194304 4785740 140736656180816 18446744073709551615 4287201 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 10157 6993 341 145 0 7202 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=334.19 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 33419 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 2099120

[startup+1062.3 s]
/proc/loadavg: 12.01 11.79 9.40 13/202 21232
/proc/meminfo: memFree=24641148/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480626293980790784 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1659156 CPUtime=354.08 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 246225 0 0 0 35367 41 0 0 25 0 1 0 546461365 1698975744 59066 33554432000 4194304 4587354 140734638447360 18446744073709551615 4357600 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 414789 59066 336 96 0 411351 0
[pid=21186] ppid=21184 vsize=41344 CPUtime=354.04 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 7271 0 0 0 35403 1 0 0 25 0 1 0 546461365 42336256 7162 33554432000 4194304 4785740 140736656180816 18446744073709551615 4309545 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 10336 7162 341 145 0 7381 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=354.19 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 35419 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134529846 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 2174780

[startup+1122.3 s]
/proc/loadavg: 12.00 11.82 9.58 13/202 21234
/proc/meminfo: memFree=24467376/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480626293980790784 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1669596 CPUtime=374.09 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 248538 0 0 0 37368 41 0 0 25 0 1 0 546461365 1709666304 61379 33554432000 4194304 4587354 140734638447360 18446744073709551615 4364904 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 417399 61379 336 96 0 413961 0
[pid=21186] ppid=21184 vsize=42552 CPUtime=374.03 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 7552 0 0 0 37402 1 0 0 25 0 1 0 546461365 43573248 7443 33554432000 4194304 4785740 140736656180816 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 10638 7443 341 145 0 7683 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=374.19 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 37419 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134528988 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 2186428

[startup+1182.3 s]
/proc/loadavg: 12.00 11.85 9.71 13/202 21236
/proc/meminfo: memFree=24520276/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1584232 CPUtime=394.09 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 253991 0 0 0 39367 42 0 0 25 0 1 0 546461365 1622253568 43085 33554432000 4194304 4587354 140734638447360 18446744073709551615 4237684 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 396058 43085 336 96 0 392620 0
[pid=21186] ppid=21184 vsize=43944 CPUtime=394.03 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 7855 0 0 0 39402 1 0 0 25 0 1 0 546461365 44998656 7746 33554432000 4194304 4785740 140736656180816 18446744073709551615 4287252 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 10986 7746 341 145 0 8031 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=394.19 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 39419 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 2102456

[startup+1242.3 s]
/proc/loadavg: 12.05 11.89 9.87 13/202 21237
/proc/meminfo: memFree=24301380/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480624782152302592 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1584628 CPUtime=414.1 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 263546 0 0 0 41366 44 0 0 25 0 1 0 546461365 1622659072 45948 33554432000 4194304 4587354 140734638447360 18446744073709551615 4237695 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 396157 45948 336 96 0 392719 0
[pid=21186] ppid=21184 vsize=44620 CPUtime=414.03 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 7989 0 0 0 41402 1 0 0 25 0 1 0 546461365 45690880 7880 33554432000 4194304 4785740 140736656180816 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 11155 7880 341 145 0 8200 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=414.18 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 41418 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 8800624 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 2103528



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.09 11.92 10.00 13/202 21301
/proc/meminfo: memFree=25423060/32950928 swapFree=67071984/67111528
[pid=21184] ppid=21182 vsize=18324 CPUtime=0 cores=5,7
/proc/21184/stat : 21184 (ppfolio) S 21182 21184 20580 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 546461365 18763776 394 33554432000 4194304 4287625 140733520397568 18446744073709551615 260905414159 0 0 4096 65536 4480624919591256064 0 0 17 7 0 0 0
/proc/21184/statm: 4581 394 345 23 0 91 0
[pid=21185] ppid=21184 vsize=1584664 CPUtime=433.33 cores=5
/proc/21185/stat : 21185 (cryptominisat) R 21184 21184 20580 0 -1 4202496 271360 0 0 0 43286 47 0 0 25 0 1 0 546461365 1622695936 43085 33554432000 4194304 4587354 140734638447360 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/21185/statm: 396166 43085 336 96 0 392728 0
[pid=21186] ppid=21184 vsize=44956 CPUtime=433.22 cores=5
/proc/21186/stat : 21186 (clasp) R 21184 21184 20580 0 -1 4202496 8065 0 0 0 43321 1 0 0 25 0 1 0 546461365 46034944 7956 33554432000 4194304 4785740 140736656180816 18446744073709551615 4287158 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21186/statm: 11239 7956 341 145 0 8284 0
[pid=21187] ppid=21184 vsize=455956 CPUtime=433.47 cores=5
/proc/21187/stat : 21187 (TNM) R 21184 21184 20580 0 -1 4202496 360 0 0 0 43347 0 0 0 25 0 1 0 546461365 466898944 256 33554432000 134512640 134534564 4290596912 18446744073709551615 134529858 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/21187/statm: 113989 256 95 6 0 112655 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 2103900

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21184 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.002998
# while last known CPU time is 1300.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.02
CPU time (s): 1300.02
CPU user time (s): 1299.54
CPU system time (s): 0.48
CPU usage (%): 100
Max. virtual memory (cumulated for all children) (KiB): 3527924

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 501
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 285
involuntary context switches= 3

runsolver used 2.08268 second user time and 5.05723 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-23 14:38:27
IDJOB=3265254
IDBENCH=85459
IDSOLVER=1613
FILE ID=node116/3265254-1303562307
RUNJOBID= node116-1303562304-21089
PBS_JOBID= 13150279
Free space on /tmp= 72584 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/harder/php-020-019.shuffled-as.sat05-1190.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265254-1303562307/watcher-3265254-1303562307 -o /tmp/evaluation-result-3265254-1303562307/solver-3265254-1303562307 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3265254-1303562307.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 81bbeaaf9f0ca3bfc36d743097777052
RANDOM SEED=1501512813

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26039216 kB
Buffers:       1815084 kB
Cached:        4581472 kB
SwapCached:       9728 kB
Active:        2990356 kB
Inactive:      3506324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26039216 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:           31192 kB
Writeback:           0 kB
AnonPages:       94028 kB
Mapped:          16700 kB
Slab:           350428 kB
PageTables:       6108 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  3942676 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72576 MiB
End job on node116 at 2011-04-23 15:00:09