Trace number 3191506

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1299.99 1300.02

General information on the benchmark

Namerandom/large/
unif-k5-r20-v2000-c40000-S1993071608-084-UNKNOWN.cnf
MD5SUM6a416a8eca39558555cbe083cf0c9cff
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark591.01
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses40000
Sum of the clauses size200000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 540000
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 4
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 4

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191506-1302538031/watcher-3191506-1302538031 -o /tmp/evaluation-result-3191506-1302538031/solver-3191506-1302538031 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3191506-1302538031.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.26 11.36 8.10 10/198 4017
/proc/meminfo: memFree=13215168/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) R 4015 4017 3790 0 -1 4202496 487 0 0 0 0 0 0 0 25 0 1 0 365402939 18763776 392 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089518485 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/4017/statm: 4581 392 343 23 0 91 0

[startup+0.0566391 s]
/proc/loadavg: 11.26 11.36 8.10 10/198 4017
/proc/meminfo: memFree=13215168/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 502 0 0 0 0 0 0 0 25 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 3973947563257594116 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100632 s]
/proc/loadavg: 11.26 11.36 8.10 10/198 4017
/proc/meminfo: memFree=13215168/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 502 0 0 0 0 0 0 0 25 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 3973947563257594116 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300489 s]
/proc/loadavg: 11.26 11.36 8.10 10/198 4017
/proc/meminfo: memFree=13215168/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 23 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700419 s]
/proc/loadavg: 11.26 11.36 8.10 10/198 4017
/proc/meminfo: memFree=13215168/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 23 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50028 s]
/proc/loadavg: 11.26 11.36 8.10 13/202 4021
/proc/meminfo: memFree=13187484/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=33444 CPUtime=0.39 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 3886 0 0 0 39 0 0 0 25 0 1 0 365402939 34246656 3417 33554432000 4194304 4587354 140737204752128 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 8361 3417 326 96 0 4923 0
[pid=4019] ppid=4017 vsize=22240 CPUtime=0.54 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 3193 0 0 0 54 0 0 0 25 0 1 0 365402939 22773760 2897 33554432000 4194304 4785740 140736757628976 18446744073709551615 4277075 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 5560 2897 340 145 0 2605 0
[pid=4020] ppid=4017 vsize=455692 CPUtime=0.54 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 1376 0 0 0 54 0 0 0 25 0 1 0 365402939 466628608 1272 33554432000 134512640 134534564 4288017568 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 113923 1272 91 6 0 112589 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 529700

[startup+3.10105 s]
/proc/loadavg: 11.26 11.36 8.10 13/202 4021
/proc/meminfo: memFree=13177316/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874761304361926656 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=33524 CPUtime=0.91 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 4859 0 0 0 91 0 0 0 25 0 1 0 365402939 34328576 4383 33554432000 4194304 4587354 140737204752128 18446744073709551615 4238582 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 8381 4383 326 96 0 4943 0
[pid=4019] ppid=4017 vsize=24908 CPUtime=1.04 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 3874 0 0 0 104 0 0 0 25 0 1 0 365402939 25505792 3578 33554432000 4194304 4785740 140736757628976 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 6227 3578 340 145 0 3272 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=1.12 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 112 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 539204

[startup+6.30049 s]
/proc/loadavg: 11.32 11.37 8.12 13/202 4021
/proc/meminfo: memFree=13162384/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874759380216578048 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=493488 CPUtime=1.99 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 7909 0 0 0 198 1 0 0 25 0 1 0 365402939 505331712 3770 33554432000 4194304 4587354 140737204752128 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 123372 3770 327 96 0 119934 0
[pid=4019] ppid=4017 vsize=31708 CPUtime=2.14 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 5548 0 0 0 214 0 0 0 25 0 1 0 365402939 32468992 5252 33554432000 4194304 4785740 140736757628976 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 7927 5252 340 145 0 4972 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=2.14 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 214 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 1005968

[startup+12.7004 s]
/proc/loadavg: 11.38 11.39 8.14 13/202 4021
/proc/meminfo: memFree=13140608/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874761304361926656 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=534864 CPUtime=4.11 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 21518 0 0 0 409 2 0 0 25 0 1 0 365402939 547700736 15093 33554432000 4194304 4587354 140737204752128 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 133716 15093 337 96 0 130278 0
[pid=4019] ppid=4017 vsize=34512 CPUtime=4.24 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 6264 0 0 0 424 0 0 0 25 0 1 0 365402939 35340288 5968 33554432000 4194304 4785740 140736757628976 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 8628 5968 340 145 0 5673 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=4.32 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 432 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 1050148

[startup+25.5011 s]
/proc/loadavg: 11.59 11.43 8.21 13/202 4022
/proc/meminfo: memFree=12957320/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874759792533438464 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=495412 CPUtime=8.39 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 24072 0 0 0 836 3 0 0 25 0 1 0 365402939 507301888 4155 33554432000 4194304 4587354 140737204752128 18446744073709551615 4239003 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 123853 4155 337 96 0 120415 0
[pid=4019] ppid=4017 vsize=41232 CPUtime=8.54 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 7917 0 0 0 853 1 0 0 25 0 1 0 365402939 42221568 7621 33554432000 4194304 4785740 140736757628976 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 10308 7621 340 145 0 7353 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=8.54 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 854 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 1017416

[startup+51.1006 s]
/proc/loadavg: 11.88 11.51 8.32 13/202 4022
/proc/meminfo: memFree=12953632/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874759655094484992 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=524708 CPUtime=16.92 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 35556 0 0 0 1687 5 0 0 25 0 1 0 365402939 537300992 10113 33554432000 4194304 4587354 140737204752128 18446744073709551615 4365254 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 131177 10113 337 96 0 127739 0
[pid=4019] ppid=4017 vsize=47784 CPUtime=17.04 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 9513 0 0 0 1703 1 0 0 25 0 1 0 365402939 48930816 9217 33554432000 4194304 4785740 140736757628976 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 11946 9217 340 145 0 8991 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=17.11 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 1711 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 1053264

[startup+102.308 s]
/proc/loadavg: 11.95 11.58 8.51 13/202 4024
/proc/meminfo: memFree=13145408/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874761029484019712 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=499624 CPUtime=33.98 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 50122 0 0 0 3390 8 0 0 25 0 1 0 365402939 511614976 5117 33554432000 4194304 4587354 140737204752128 18446744073709551615 4244609 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 124906 5117 337 96 0 121468 0
[pid=4019] ppid=4017 vsize=58260 CPUtime=34.13 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 12123 0 0 0 3412 1 0 0 25 0 1 0 365402939 59658240 11827 33554432000 4194304 4785740 140736757628976 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 14565 11827 340 145 0 11610 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=34.16 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 3416 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528896 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 1038656

[startup+162.301 s]
/proc/loadavg: 11.98 11.66 8.72 13/202 4025
/proc/meminfo: memFree=12940760/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874760892045066240 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=566528 CPUtime=53.99 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 75624 0 0 0 5386 13 0 0 25 0 1 0 365402939 580124672 22828 33554432000 4194304 4587354 140737204752128 18446744073709551615 4365336 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 141632 22828 337 96 0 138194 0
[pid=4019] ppid=4017 vsize=64928 CPUtime=54.14 cores=4

################
# More data... #
################

/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 822.28
Current children cumulated vsize (KiB) 1224752

[startup+882.301 s]
/proc/loadavg: 12.00 11.94 10.45 13/202 4197
/proc/meminfo: memFree=13363152/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874761029484019712 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=629940 CPUtime=294.03 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 282508 0 0 0 29350 53 0 0 25 0 1 0 365402939 645058560 40789 33554432000 4194304 4587354 140737204752128 18446744073709551615 4365352 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 157485 40789 337 96 0 154047 0
[pid=4019] ppid=4017 vsize=116816 CPUtime=294.09 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 26352 0 0 0 29405 4 0 0 25 0 1 0 365402939 119619584 26056 33554432000 4194304 4785740 140736757628976 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 29204 26056 340 145 0 26249 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=294.17 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 29417 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 1227528

[startup+942.301 s]
/proc/loadavg: 12.00 11.95 10.55 13/202 4199
/proc/meminfo: memFree=13508332/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874759517655531520 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=548380 CPUtime=314.03 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 293104 0 0 0 31348 55 0 0 25 0 1 0 365402939 561541120 23037 33554432000 4194304 4587354 140737204752128 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 137095 23037 337 96 0 133657 0
[pid=4019] ppid=4017 vsize=117476 CPUtime=314.1 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 26517 0 0 0 31405 5 0 0 25 0 1 0 365402939 120295424 26221 33554432000 4194304 4785740 140736757628976 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 29369 26221 340 145 0 26414 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=314.16 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 31416 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 942.29
Current children cumulated vsize (KiB) 1146628

[startup+1002.3 s]
/proc/loadavg: 12.06 11.97 10.64 13/202 4201
/proc/meminfo: memFree=13453496/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874759792533438464 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=550020 CPUtime=334.04 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 305139 0 0 0 33347 57 0 0 25 0 1 0 365402939 563220480 24516 33554432000 4194304 4587354 140737204752128 18446744073709551615 248089394840 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 137505 24516 337 96 0 134067 0
[pid=4019] ppid=4017 vsize=119428 CPUtime=334.09 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 26999 0 0 0 33404 5 0 0 25 0 1 0 365402939 122294272 26703 33554432000 4194304 4785740 140736757628976 18446744073709551615 4278573 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 29857 26703 340 145 0 26902 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=334.16 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 33416 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134530630 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 1150220

[startup+1062.3 s]
/proc/loadavg: 12.05 11.99 10.73 13/202 4202
/proc/meminfo: memFree=13435368/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874760067411345408 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=551788 CPUtime=354.04 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 316905 0 0 0 35344 60 0 0 25 0 1 0 365402939 565030912 24972 33554432000 4194304 4587354 140737204752128 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 137947 24972 337 96 0 134509 0
[pid=4019] ppid=4017 vsize=120148 CPUtime=354.1 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 27146 0 0 0 35405 5 0 0 25 0 1 0 365402939 123031552 26850 33554432000 4194304 4785740 140736757628976 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 30037 26850 340 145 0 27082 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=354.16 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 35416 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 1152708

[startup+1122.3 s]
/proc/loadavg: 12.02 11.99 10.80 13/202 4204
/proc/meminfo: memFree=13118276/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874760204850298880 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=569232 CPUtime=374.03 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 328281 0 0 0 37341 62 0 0 25 0 1 0 365402939 582893568 24222 33554432000 4194304 4587354 140737204752128 18446744073709551615 4238522 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 142308 24222 337 96 0 138870 0
[pid=4019] ppid=4017 vsize=121084 CPUtime=374.1 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 27362 0 0 0 37405 5 0 0 25 0 1 0 365402939 123990016 27066 33554432000 4194304 4785740 140736757628976 18446744073709551615 4416773 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 30271 27066 340 145 0 27316 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=374.15 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 37415 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 1122.28
Current children cumulated vsize (KiB) 1171088

[startup+1182.3 s]
/proc/loadavg: 12.00 11.99 10.87 13/202 4205
/proc/meminfo: memFree=13313804/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874759517655531520 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=664116 CPUtime=394.03 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 357176 0 0 0 39338 65 0 0 25 0 1 0 365402939 680054784 46769 33554432000 4194304 4587354 140737204752128 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 166029 46769 337 96 0 162591 0
[pid=4019] ppid=4017 vsize=128260 CPUtime=394.11 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 29150 0 0 0 39406 5 0 0 25 0 1 0 365402939 131338240 28854 33554432000 4194304 4785740 140736757628976 18446744073709551615 4287055 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 32065 28854 340 145 0 29110 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=394.15 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 39415 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 1182.29
Current children cumulated vsize (KiB) 1273148

[startup+1242.3 s]
/proc/loadavg: 12.03 12.00 10.95 13/202 4207
/proc/meminfo: memFree=13280796/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874759517655531520 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=664116 CPUtime=414.03 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 357176 0 0 0 41338 65 0 0 25 0 1 0 365402939 680054784 46769 33554432000 4194304 4587354 140737204752128 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 166029 46769 337 96 0 162591 0
[pid=4019] ppid=4017 vsize=132520 CPUtime=414.12 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 30154 0 0 0 41407 5 0 0 25 0 1 0 365402939 135700480 29858 33554432000 4194304 4785740 140736757628976 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 33130 29858 340 145 0 30175 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=414.15 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 41415 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 1242.3
Current children cumulated vsize (KiB) 1277408



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.01 12.00 11.01 13/202 4209
/proc/meminfo: memFree=13240600/32950928 swapFree=67111528/67111528
[pid=4017] ppid=4015 vsize=18324 CPUtime=0 cores=4,6
/proc/4017/stat : 4017 (ppfolio) S 4015 4017 3790 0 -1 4202496 503 0 0 0 0 0 0 0 15 0 1 0 365402939 18763776 394 33554432000 4194304 4287625 140733254350192 18446744073709551615 248089718287 0 0 4096 65536 16874759517655531520 0 0 17 6 0 0 0
/proc/4017/statm: 4581 394 345 23 0 91 0
[pid=4018] ppid=4017 vsize=672892 CPUtime=433.22 cores=4
/proc/4018/stat : 4018 (cryptominisat) R 4017 4017 3790 0 -1 4202496 359217 0 0 0 43257 65 0 0 25 0 1 0 365402939 689041408 48810 33554432000 4194304 4587354 140737204752128 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/4018/statm: 168223 48810 337 96 0 164785 0
[pid=4019] ppid=4017 vsize=134800 CPUtime=433.37 cores=4
/proc/4019/stat : 4019 (clasp) R 4017 4017 3790 0 -1 4202496 30709 0 0 0 43332 5 0 0 25 0 1 0 365402939 138035200 30413 33554432000 4194304 4785740 140736757628976 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4019/statm: 33700 30413 340 145 0 30745 0
[pid=4020] ppid=4017 vsize=462448 CPUtime=433.4 cores=4
/proc/4020/stat : 4020 (TNM) R 4017 4017 3790 0 -1 4202496 2355 0 0 0 43340 0 0 0 25 0 1 0 365402939 473546752 2251 33554432000 134512640 134534564 4288017568 18446744073709551615 134528944 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4020/statm: 115612 2251 95 6 0 114278 0
Current children cumulated CPU time (s) 1299.99
Current children cumulated vsize (KiB) 1288464

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4017 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.002998
# while last known CPU time is 1299.99
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.02
CPU time (s): 1299.99
CPU user time (s): 1299.29
CPU system time (s): 0.7
CPU usage (%): 99.9975
Max. virtual memory (cumulated for all children) (KiB): 1572312

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 503
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 226
involuntary context switches= 3

runsolver used 2.05769 second user time and 5.04723 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-11 18:07:11
IDJOB=3191506
IDBENCH=82637
IDSOLVER=1613
FILE ID=node123/3191506-1302538031
RUNJOBID= node123-1302537048-3809
PBS_JOBID= 12951127
Free space on /tmp= 71476 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k5-r20-v2000-c40000-S1993071608-084-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191506-1302538031/watcher-3191506-1302538031 -o /tmp/evaluation-result-3191506-1302538031/solver-3191506-1302538031 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3191506-1302538031.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 6a416a8eca39558555cbe083cf0c9cff
RANDOM SEED=151478814

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13215200 kB
Buffers:        677692 kB
Cached:       17365444 kB
SwapCached:          0 kB
Active:       10772656 kB
Inactive:      8556500 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13215200 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10900 kB
Writeback:           0 kB
AnonPages:     1285148 kB
Mapped:          17940 kB
Slab:           339160 kB
PageTables:       8664 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  5236836 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71468 MiB
End job on node123 at 2011-04-11 18:28:53