Trace number 3191491

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300 1300.01

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v35000-c147000-S1886449473-022-UNKNOWN.cnf
MD5SUM48acd8df0141c3f57a132eb6d7253d5f
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark130.328
Satisfiable
(Un)Satisfiability was proved
Number of variables35000
Number of clauses147000
Sum of the clauses size441000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3147000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 1

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191491-1302537635/watcher-3191491-1302537635 -o /tmp/evaluation-result-3191491-1302537635/solver-3191491-1302537635 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3191491-1302537635.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.02 9.54 5.92 9/197 3170
/proc/meminfo: memFree=15102000/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) R 3168 3170 2986 0 -1 4202496 486 0 0 0 0 0 0 0 25 0 1 0 365366280 18763776 392 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370777493 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/3170/statm: 4581 392 343 23 0 91 0

[startup+0.094752 s]
/proc/loadavg: 11.02 9.54 5.92 9/197 3170
/proc/meminfo: memFree=15102000/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 500 0 0 0 0 0 0 0 25 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 3668019447945199880 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100745 s]
/proc/loadavg: 11.02 9.54 5.92 9/197 3170
/proc/meminfo: memFree=15102000/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 500 0 0 0 0 0 0 0 25 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 3668019447945199880 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300714 s]
/proc/loadavg: 11.02 9.54 5.92 9/197 3170
/proc/meminfo: memFree=15102000/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 23 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700652 s]
/proc/loadavg: 11.02 9.54 5.92 9/197 3170
/proc/meminfo: memFree=15102000/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 19 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432888428600229888 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5005 s]
/proc/loadavg: 11.01 9.57 5.95 12/201 3174
/proc/meminfo: memFree=15034016/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 16 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432888703478136832 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=59096 CPUtime=0.45 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 11265 0 0 0 44 1 0 0 25 0 1 0 365366280 60514304 9582 33554432000 4194304 4587354 140733241499696 18446744073709551615 4383298 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 14774 9582 314 96 0 11336 0
[pid=3172] ppid=3170 vsize=31440 CPUtime=0.51 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 6964 0 0 0 51 0 0 0 25 0 1 0 365366280 32194560 5052 33554432000 4194304 4785740 140736223975552 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 7860 5052 339 145 0 4905 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=0.5 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 49 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134529964 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 574848

[startup+3.10122 s]
/proc/loadavg: 11.01 9.57 5.95 12/201 3174
/proc/meminfo: memFree=15022112/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889115794997248 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=57160 CPUtime=1.04 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 12065 0 0 0 103 1 0 0 25 0 1 0 365366280 58531840 9266 33554432000 4194304 4587354 140733241499696 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 14290 9266 326 96 0 10852 0
[pid=3172] ppid=3170 vsize=31440 CPUtime=1.01 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 6965 0 0 0 101 0 0 0 25 0 1 0 365366280 32194560 5053 33554432000 4194304 4785740 140736223975552 18446744073709551615 4319122 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 7860 5053 340 145 0 4905 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=1.02 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 101 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134528864 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 572912

[startup+6.30065 s]
/proc/loadavg: 11.01 9.59 5.98 12/201 3174
/proc/meminfo: memFree=15005216/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889115794997248 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=57160 CPUtime=2.05 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 12915 0 0 0 204 1 0 0 25 0 1 0 365366280 58531840 10114 33554432000 4194304 4587354 140733241499696 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 14290 10114 326 96 0 10852 0
[pid=3172] ppid=3170 vsize=33044 CPUtime=2.11 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 7425 0 0 0 211 0 0 0 25 0 1 0 365366280 33837056 5513 33554432000 4194304 4785740 140736223975552 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 8261 5513 340 145 0 5306 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=2.1 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 209 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 574516

[startup+12.7005 s]
/proc/loadavg: 11.01 9.61 6.00 12/201 3174
/proc/meminfo: memFree=14981832/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889390672904192 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=94664 CPUtime=4.23 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 14387 0 0 0 422 1 0 0 25 0 1 0 365366280 96935936 11582 33554432000 4194304 4587354 140733241499696 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 23666 11582 326 96 0 20228 0
[pid=3172] ppid=3170 vsize=41804 CPUtime=4.21 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 9622 0 0 0 420 1 0 0 25 0 1 0 365366280 42807296 7710 33554432000 4194304 4785740 140736223975552 18446744073709551615 4553035 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 10451 7710 340 145 0 7496 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=4.22 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 421 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134530379 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 620780

[startup+25.5013 s]
/proc/loadavg: 11.01 9.68 6.08 12/201 3175
/proc/meminfo: memFree=14965308/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889665550811136 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=94664 CPUtime=8.45 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 17075 0 0 0 843 2 0 0 25 0 1 0 365366280 96935936 14261 33554432000 4194304 4587354 140733241499696 18446744073709551615 4241286 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 23666 14261 326 96 0 20228 0
[pid=3172] ppid=3170 vsize=61636 CPUtime=8.51 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 14584 0 0 0 848 3 0 0 25 0 1 0 365366280 63115264 12672 33554432000 4194304 4785740 140736223975552 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 15409 12672 340 145 0 12454 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=8.5 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 849 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 640612

[startup+51.1007 s]
/proc/loadavg: 11.00 9.78 6.21 12/201 3185
/proc/meminfo: memFree=14787576/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432887741405462528 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=1163232 CPUtime=17.03 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 46104 0 0 0 1697 6 0 0 25 0 1 0 365366280 1191149568 13134 33554432000 4194304 4587354 140733241499696 18446744073709551615 4238728 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 290808 13134 337 96 0 287370 0
[pid=3172] ppid=3170 vsize=97960 CPUtime=17.01 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 23605 0 0 0 1695 6 0 0 25 0 1 0 365366280 100311040 21693 33554432000 4194304 4785740 140736223975552 18446744073709551615 4546132 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 24490 21693 340 145 0 21535 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=17.02 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 1701 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 1745504

[startup+102.307 s]
/proc/loadavg: 11.00 9.97 6.46 12/201 3187
/proc/meminfo: memFree=14685628/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432888428600229888 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=69060 CPUtime=34.07 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 72604 0 0 0 3394 13 0 0 25 0 1 0 365366280 70717440 11170 33554432000 4194304 4587354 140733241499696 18446744073709551615 4238719 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 17265 11170 337 96 0 13827 0
[pid=3172] ppid=3170 vsize=126508 CPUtime=34.1 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 30750 0 0 0 3403 7 0 0 25 0 1 0 365366280 129544192 28838 33554432000 4194304 4785740 140736223975552 18446744073709551615 4546313 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 31627 28838 340 145 0 28672 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=34.1 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 3409 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134528972 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 679880

[startup+162.301 s]
/proc/loadavg: 11.06 10.17 6.75 12/201 3188
/proc/meminfo: memFree=14765320/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889115794997248 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=141628 CPUtime=54.07 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 98331 0 0 0 5388 19 0 0 25 0 1 0 365366280 145027072 15803 33554432000 4194304 4587354 140733241499696 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 35407 15803 337 96 0 31969 0
[pid=3172] ppid=3170 vsize=150692 CPUtime=54.1 cores=1

################
# More data... #
################

/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 822.29
Current children cumulated vsize (KiB) 1965884

[startup+882.3 s]
/proc/loadavg: 10.89 10.82 8.98 12/201 3376
/proc/meminfo: memFree=15447600/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889390672904192 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=1195560 CPUtime=294.1 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 325737 0 0 0 29347 63 0 0 25 0 1 0 365366280 1224253440 25874 33554432000 4194304 4587354 140733241499696 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 298890 25874 337 96 0 295452 0
[pid=3172] ppid=3170 vsize=280984 CPUtime=294.07 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 68568 0 0 0 29390 17 0 0 25 0 1 0 365366280 287727616 66656 33554432000 4194304 4785740 140736223975552 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 70246 66656 340 145 0 67291 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=294.13 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 29412 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134525873 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 1960856

[startup+942.301 s]
/proc/loadavg: 10.96 10.85 9.11 12/201 3377
/proc/meminfo: memFree=15419172/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889115794997248 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=1195560 CPUtime=314.09 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 364538 0 0 0 31341 68 0 0 25 0 1 0 365366280 1224253440 28443 33554432000 4194304 4587354 140733241499696 18446744073709551615 4243416 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 298890 28443 337 96 0 295452 0
[pid=3172] ppid=3170 vsize=280984 CPUtime=314.07 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 68568 0 0 0 31390 17 0 0 25 0 1 0 365366280 287727616 66656 33554432000 4194304 4785740 140736223975552 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 70246 66656 340 145 0 67291 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=314.13 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 31412 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134529024 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 942.29
Current children cumulated vsize (KiB) 1960856

[startup+1002.3 s]
/proc/loadavg: 10.98 10.88 9.22 12/201 3379
/proc/meminfo: memFree=15421852/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889253233950720 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=1214800 CPUtime=334.09 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 372589 0 0 0 33338 71 0 0 25 0 1 0 365366280 1243955200 22398 33554432000 4194304 4587354 140733241499696 18446744073709551615 4230260 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 303700 22398 337 96 0 300262 0
[pid=3172] ppid=3170 vsize=292144 CPUtime=334.07 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 71364 0 0 0 33389 18 0 0 25 0 1 0 365366280 299155456 69452 33554432000 4194304 4785740 140736223975552 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 73036 69452 340 145 0 70081 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=334.14 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 33413 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 1991256

[startup+1062.3 s]
/proc/loadavg: 11.07 10.91 9.34 12/201 3380
/proc/meminfo: memFree=15403464/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889390672904192 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=1220044 CPUtime=354.08 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 380379 0 0 0 35336 72 0 0 25 0 1 0 365366280 1249325056 22678 33554432000 4194304 4587354 140733241499696 18446744073709551615 4237556 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 305011 22678 337 96 0 301573 0
[pid=3172] ppid=3170 vsize=293008 CPUtime=354.06 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 71549 0 0 0 35388 18 0 0 25 0 1 0 365366280 300040192 69637 33554432000 4194304 4785740 140736223975552 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 73252 69637 340 145 0 70297 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=354.15 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 35414 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 1062.29
Current children cumulated vsize (KiB) 1997364

[startup+1122.3 s]
/proc/loadavg: 11.02 10.92 9.44 12/201 3382
/proc/meminfo: memFree=15389152/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889528111857664 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=1205404 CPUtime=374.08 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 389527 0 0 0 37333 75 0 0 25 0 1 0 365366280 1234333696 23956 33554432000 4194304 4587354 140733241499696 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 301351 23956 337 96 0 297913 0
[pid=3172] ppid=3170 vsize=304452 CPUtime=374.06 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 74356 0 0 0 37388 18 0 0 25 0 1 0 365366280 311758848 72444 33554432000 4194304 4785740 140736223975552 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 76113 72444 340 145 0 73158 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=374.15 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 37414 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 1122.29
Current children cumulated vsize (KiB) 1994168

[startup+1182.3 s]
/proc/loadavg: 11.01 10.94 9.53 12/201 3384
/proc/meminfo: memFree=15380928/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889665550811136 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=174676 CPUtime=394.08 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 398543 0 0 0 39331 77 0 0 25 0 1 0 365366280 178868224 25061 33554432000 4194304 4587354 140733241499696 18446744073709551615 4238618 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 43669 25061 337 96 0 40231 0
[pid=3172] ppid=3170 vsize=304452 CPUtime=394.07 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 74357 0 0 0 39389 18 0 0 25 0 1 0 365366280 311758848 72445 33554432000 4194304 4785740 140736223975552 18446744073709551615 4549837 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 76113 72445 340 145 0 73158 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=394.14 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 39413 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 1182.29
Current children cumulated vsize (KiB) 963440

[startup+1242.3 s]
/proc/loadavg: 11.00 10.94 9.62 12/201 3385
/proc/meminfo: memFree=15369600/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889802989764608 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=1215800 CPUtime=414.07 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 407403 0 0 0 41328 79 0 0 25 0 1 0 365366280 1244979200 25650 33554432000 4194304 4587354 140733241499696 18446744073709551615 4244096 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 303950 25650 337 96 0 300512 0
[pid=3172] ppid=3170 vsize=304740 CPUtime=414.08 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 74423 0 0 0 41390 18 0 0 25 0 1 0 365366280 312053760 72511 33554432000 4194304 4785740 140736223975552 18446744073709551615 4553090 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 76185 72511 340 145 0 73230 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=414.14 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 41413 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134530268 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 1242.29
Current children cumulated vsize (KiB) 2004852



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 11.06 10.97 9.71 12/201 3387
/proc/meminfo: memFree=15297508/32951124 swapFree=67111528/67111528
[pid=3170] ppid=3168 vsize=18324 CPUtime=0 cores=1,3
/proc/3170/stat : 3170 (ppfolio) S 3168 3170 2986 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 365366280 18763776 394 33554432000 4194304 4287625 140736119736048 18446744073709551615 218370977295 0 0 4096 65536 10432889115794997248 0 0 17 3 0 0 0
/proc/3170/statm: 4581 394 345 23 0 91 0
[pid=3171] ppid=3170 vsize=1267916 CPUtime=433.31 cores=1
/proc/3171/stat : 3171 (cryptominisat) R 3170 3170 2986 0 -1 4202496 430224 0 0 0 43249 82 0 0 25 0 1 0 365366280 1298345984 40080 33554432000 4194304 4587354 140733241499696 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3171/statm: 316979 40080 337 96 0 313541 0
[pid=3172] ppid=3170 vsize=316112 CPUtime=433.35 cores=1
/proc/3172/stat : 3172 (clasp) R 3170 3170 2986 0 -1 4202496 77286 0 0 0 43316 19 0 0 25 0 1 0 365366280 323698688 75374 33554432000 4194304 4785740 140736223975552 18446744073709551615 4278600 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3172/statm: 79028 75374 340 145 0 76073 0
[pid=3173] ppid=3170 vsize=465988 CPUtime=433.34 cores=1
/proc/3173/stat : 3173 (TNM) R 3170 3170 2986 0 -1 4202496 5913 0 0 0 43333 1 0 0 25 0 1 0 365366280 477171712 5809 33554432000 134512640 134534564 4294785168 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/3173/statm: 116497 5809 95 6 0 115163 0
Current children cumulated CPU time (s) 1300
Current children cumulated vsize (KiB) 2068340

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3170 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.004998
# while last known CPU time is 1300
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300
CPU user time (s): 1298.98
CPU system time (s): 1.02
CPU usage (%): 99.9989
Max. virtual memory (cumulated for all children) (KiB): 3057452

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 501
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 201
involuntary context switches= 4

runsolver used 2.02269 second user time and 5.08223 second system time

The end

Launcher Data 

Begin job on node101 at 2011-04-11 18:00:35
IDJOB=3191491
IDBENCH=82622
IDSOLVER=1613
FILE ID=node101/3191491-1302537635
RUNJOBID= node101-1302537098-3006
PBS_JOBID= 12951129
Free space on /tmp= 71312 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v35000-c147000-S1886449473-022-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191491-1302537635/watcher-3191491-1302537635 -o /tmp/evaluation-result-3191491-1302537635/solver-3191491-1302537635 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3191491-1302537635.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 48acd8df0141c3f57a132eb6d7253d5f
RANDOM SEED=897634485

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15102032 kB
Buffers:        687644 kB
Cached:       15868644 kB
SwapCached:          0 kB
Active:        6853852 kB
Inactive:     10582560 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15102032 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           12828 kB
Writeback:           0 kB
AnonPages:      880168 kB
Mapped:          17548 kB
Slab:           346292 kB
PageTables:       7708 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  3633676 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71308 MiB
End job on node101 at 2011-04-11 18:22:17