Trace number 3219232

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 5000.1 5000.01

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v25000-c105000-S1838224332-006-UNKNOWN.cnf
MD5SUMa93695501183427990f531672c9572d2
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark96.1674
Satisfiable
(Un)Satisfiability was proved
Number of variables24998
Number of clauses105000
Sum of the clauses size315000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3105000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 0
0.00/0.00	Starting TNM 2009 on core(s) 0

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3219232-1303223664/watcher-3219232-1303223664 -o /tmp/evaluation-result-3219232-1303223664/solver-3219232-1303223664 -C 5000 -W 5000 -M 15500 ppfolio --nbcore=1 HOME/instance-3219232-1303223664.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.02 6.02 5.91 5/180 953
/proc/meminfo: memFree=27742612/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=4 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (runsolver) R 951 953 32262 0 -1 4202560 46 0 0 0 0 0 0 0 25 0 1 0 433969185 4096 1 33554432000 0 0 0 0 0 0 0 4096 24578 18446744073709551615 0 0 17 2 0 0 0
/proc/953/statm: 1 1 0 0 0 1 0

[startup+0.0522809 s]
/proc/loadavg: 6.02 6.02 5.91 5/180 953
/proc/meminfo: memFree=27742612/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 500 0 0 0 0 0 0 0 25 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 4255181197165953284 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100275 s]
/proc/loadavg: 6.02 6.02 5.91 5/180 953
/proc/meminfo: memFree=27742612/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 500 0 0 0 0 0 0 0 25 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 4255181197165953284 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300252 s]
/proc/loadavg: 6.02 6.02 5.91 5/180 953
/proc/meminfo: memFree=27742612/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 23 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669627903615696896 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701173 s]
/proc/loadavg: 6.02 6.02 5.91 5/180 953
/proc/meminfo: memFree=27742612/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 20 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669628178493603840 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50104 s]
/proc/loadavg: 6.02 6.02 5.91 7/184 957
/proc/meminfo: memFree=27682936/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669628590810464256 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=47212 CPUtime=0.54 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 8731 0 0 0 53 1 0 0 25 0 1 0 433969186 48345088 6710 33554432000 4194304 4587354 140733998271456 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 11803 6710 326 96 0 8365 0
[pid=956] ppid=953 vsize=25808 CPUtime=0.41 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 5077 0 0 0 41 0 0 0 25 0 1 0 433969186 26427392 3731 33554432000 4194304 4785740 140736989686928 18446744073709551615 4553068 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 6452 3731 340 145 0 3497 0
[pid=957] ppid=953 vsize=461896 CPUtime=0.51 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 51 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134530890 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 553240

[startup+3.10073 s]
/proc/loadavg: 6.02 6.02 5.91 7/184 957
/proc/meminfo: memFree=27682812/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669628590810464256 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=47212 CPUtime=1.04 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 9224 0 0 0 103 1 0 0 25 0 1 0 433969186 48345088 7201 33554432000 4194304 4587354 140733998271456 18446744073709551615 4243943 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 11803 7201 326 96 0 8365 0
[pid=956] ppid=953 vsize=25808 CPUtime=0.92 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 5077 0 0 0 92 0 0 0 25 0 1 0 433969186 26427392 3731 33554432000 4194304 4785740 140736989686928 18446744073709551615 4552993 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 6452 3731 340 145 0 3497 0
[pid=957] ppid=953 vsize=461896 CPUtime=1.1 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 110 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 553240

[startup+6.30118 s]
/proc/loadavg: 6.01 6.02 5.91 7/184 957
/proc/meminfo: memFree=27675632/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669628728249417728 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=47212 CPUtime=2.13 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 10133 0 0 0 212 1 0 0 25 0 1 0 433969186 48345088 8104 33554432000 4194304 4587354 140733998271456 18446744073709551615 4230260 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 11803 8104 326 96 0 8365 0
[pid=956] ppid=953 vsize=30360 CPUtime=2.01 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 6252 0 0 0 201 0 0 0 25 0 1 0 433969186 31088640 4906 33554432000 4194304 4785740 140736989686928 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 7590 4906 340 145 0 4635 0
[pid=957] ppid=953 vsize=461896 CPUtime=2.11 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 211 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 6.25
Current children cumulated vsize (KiB) 557792

[startup+12.701 s]
/proc/loadavg: 6.01 6.02 5.91 7/184 957
/proc/meminfo: memFree=27650488/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629003127324672 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=84716 CPUtime=4.24 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 11691 0 0 0 422 2 0 0 25 0 1 0 433969186 86749184 9656 33554432000 4194304 4587354 140733998271456 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 21179 9656 326 96 0 17741 0
[pid=956] ppid=953 vsize=41380 CPUtime=4.13 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 9012 0 0 0 412 1 0 0 25 0 1 0 433969186 42373120 7666 33554432000 4194304 4785740 140736989686928 18446744073709551615 4546082 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 10345 7666 340 145 0 7390 0
[pid=957] ppid=953 vsize=461896 CPUtime=4.3 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 430 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 606316

[startup+25.5008 s]
/proc/loadavg: 6.01 6.02 5.91 7/184 958
/proc/meminfo: memFree=27644644/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669627353859883008 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2042492 CPUtime=8.54 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 16105 0 0 0 851 3 0 0 25 0 1 0 433969186 2091511808 8482 33554432000 4194304 4587354 140733998271456 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 510623 8482 331 96 0 507185 0
[pid=956] ppid=953 vsize=63056 CPUtime=8.41 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 14378 0 0 0 839 2 0 0 25 0 1 0 433969186 64569344 13032 33554432000 4194304 4785740 140736989686928 18446744073709551615 4552983 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 15764 13032 340 145 0 12809 0
[pid=957] ppid=953 vsize=461896 CPUtime=8.51 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 851 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134528934 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 2585768

[startup+51.1012 s]
/proc/loadavg: 6.00 6.01 5.91 7/184 958
/proc/meminfo: memFree=27599768/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669627491298836480 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=56056 CPUtime=17.04 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 39502 0 0 0 1697 7 0 0 25 0 1 0 433969186 57401344 10476 33554432000 4194304 4587354 140733998271456 18446744073709551615 4238739 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 14014 10476 337 96 0 10576 0
[pid=956] ppid=953 vsize=78720 CPUtime=16.93 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 18321 0 0 0 1690 3 0 0 25 0 1 0 433969186 80609280 16975 33554432000 4194304 4785740 140736989686928 18446744073709551615 4553143 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 19680 16975 340 145 0 16725 0
[pid=957] ppid=953 vsize=461896 CPUtime=17.1 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 1710 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 614996

[startup+102.307 s]
/proc/loadavg: 6.00 6.01 5.91 7/184 960
/proc/meminfo: memFree=27529904/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669628041054650368 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2061436 CPUtime=34.14 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 67417 0 0 0 3403 11 0 0 25 0 1 0 433969186 2110910464 16253 33554432000 4194304 4587354 140733998271456 18446744073709551615 4238739 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 515359 16253 337 96 0 511921 0
[pid=956] ppid=953 vsize=102680 CPUtime=34.01 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 24191 0 0 0 3397 4 0 0 25 0 1 0 433969186 105144320 22845 33554432000 4194304 4785740 140736989686928 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 25670 22845 340 145 0 22715 0
[pid=957] ppid=953 vsize=461896 CPUtime=34.13 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 3413 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2644336

[startup+162.3 s]
/proc/loadavg: 6.00 6.00 5.91 7/184 961
/proc/meminfo: memFree=27539524/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669628590810464256 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2071008 CPUtime=54.13 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 103854 0 0 0 5397 16 0 0 25 0 1 0 433969186 2120712192 14204 33554432000 4194304 4587354 140733998271456 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 517752 14204 337 96 0 514314 0
[pid=956] ppid=953 vsize=130412 CPUtime=54 cores=0

################
# More data... #
################

/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 4542.37
Current children cumulated vsize (KiB) 3028240

[startup+4602.3 s]
/proc/loadavg: 3.21 4.76 5.48 4/175 1111
/proc/meminfo: memFree=27279796/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629140566278144 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2124000 CPUtime=1534.14 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 985693 0 0 0 153210 204 0 0 25 0 1 0 433969186 2174976000 33758 33554432000 4194304 4587354 140733998271456 18446744073709551615 218370653886 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 531000 33758 337 96 0 527562 0
[pid=956] ppid=953 vsize=424020 CPUtime=1534.08 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 103163 0 0 0 153381 27 0 0 25 0 1 0 433969186 434196480 101817 33554432000 4194304 4785740 140736989686928 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 106005 101817 340 145 0 103050 0
[pid=957] ppid=953 vsize=461896 CPUtime=1534.17 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 153417 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134526098 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 4602.39
Current children cumulated vsize (KiB) 3028240

[startup+4662.3 s]
/proc/loadavg: 3.07 4.43 5.32 4/175 1112
/proc/meminfo: memFree=27318552/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629140566278144 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2086972 CPUtime=1554.14 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 996882 0 0 0 155206 208 0 0 25 0 1 0 433969186 2137059328 24141 33554432000 4194304 4587354 140733998271456 18446744073709551615 4238224 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 521743 24141 337 96 0 518305 0
[pid=956] ppid=953 vsize=424388 CPUtime=1554.07 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 103215 0 0 0 155380 27 0 0 25 0 1 0 433969186 434573312 101869 33554432000 4194304 4785740 140736989686928 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 106097 101869 340 145 0 103142 0
[pid=957] ppid=953 vsize=461896 CPUtime=1554.17 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 155417 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 4662.38
Current children cumulated vsize (KiB) 2991580

[startup+4722.31 s]
/proc/loadavg: 3.02 4.17 5.17 4/175 1114
/proc/meminfo: memFree=27263684/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629140566278144 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2086972 CPUtime=1574.15 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 1005749 0 0 0 157205 210 0 0 25 0 1 0 433969186 2137059328 32969 33554432000 4194304 4587354 140733998271456 18446744073709551615 4238739 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 521743 32969 337 96 0 518305 0
[pid=956] ppid=953 vsize=444044 CPUtime=1574.07 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 108060 0 0 0 157379 28 0 0 25 0 1 0 433969186 454701056 106714 33554432000 4194304 4785740 140736989686928 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 111011 106714 340 145 0 108056 0
[pid=957] ppid=953 vsize=461896 CPUtime=1574.16 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 157416 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 4722.38
Current children cumulated vsize (KiB) 3011236

[startup+4782.3 s]
/proc/loadavg: 3.01 3.96 5.03 4/175 1116
/proc/meminfo: memFree=27301564/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629140566278144 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2086664 CPUtime=1594.15 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 1016856 0 0 0 159203 212 0 0 25 0 1 0 433969186 2136743936 23380 33554432000 4194304 4587354 140733998271456 18446744073709551615 4238131 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 521666 23380 337 96 0 518228 0
[pid=956] ppid=953 vsize=444640 CPUtime=1594.07 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 108203 0 0 0 159378 29 0 0 25 0 1 0 433969186 455311360 106857 33554432000 4194304 4785740 140736989686928 18446744073709551615 4553106 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 111160 106857 340 145 0 108205 0
[pid=957] ppid=953 vsize=461896 CPUtime=1594.16 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 159416 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134528273 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 4782.38
Current children cumulated vsize (KiB) 3011524

[startup+4842.3 s]
/proc/loadavg: 3.00 3.78 4.90 4/175 1117
/proc/meminfo: memFree=27265172/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629140566278144 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2086664 CPUtime=1614.16 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 1025907 0 0 0 161202 214 0 0 25 0 1 0 433969186 2136743936 32383 33554432000 4194304 4587354 140733998271456 18446744073709551615 4241168 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 521666 32383 337 96 0 518228 0
[pid=956] ppid=953 vsize=444640 CPUtime=1614.07 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 108214 0 0 0 161378 29 0 0 25 0 1 0 433969186 455311360 106868 33554432000 4194304 4785740 140736989686928 18446744073709551615 4553010 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 111160 106868 340 145 0 108205 0
[pid=957] ppid=953 vsize=461896 CPUtime=1614.16 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 161416 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134525840 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 4842.39
Current children cumulated vsize (KiB) 3011524

[startup+4902.3 s]
/proc/loadavg: 3.00 3.64 4.78 4/175 1119
/proc/meminfo: memFree=27278864/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629278005231616 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2090612 CPUtime=1634.17 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 1036834 0 0 0 163201 216 0 0 25 0 1 0 433969186 2140786688 22051 33554432000 4194304 4587354 140733998271456 18446744073709551615 4238297 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 522653 22051 337 96 0 519215 0
[pid=956] ppid=953 vsize=473668 CPUtime=1634.07 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 115410 0 0 0 163376 31 0 0 25 0 1 0 433969186 485036032 114064 33554432000 4194304 4785740 140736989686928 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 118417 114064 340 145 0 115462 0
[pid=957] ppid=953 vsize=461896 CPUtime=1634.15 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 163415 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 4902.39
Current children cumulated vsize (KiB) 3044500

[startup+4962.3 s]
/proc/loadavg: 3.00 3.52 4.67 4/175 1120
/proc/meminfo: memFree=27240492/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629278005231616 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2090612 CPUtime=1654.18 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 1046067 0 0 0 165200 218 0 0 25 0 1 0 433969186 2140786688 31254 33554432000 4194304 4587354 140733998271456 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 522653 31254 337 96 0 519215 0
[pid=956] ppid=953 vsize=474196 CPUtime=1654.07 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 115539 0 0 0 165376 31 0 0 25 0 1 0 433969186 485576704 114193 33554432000 4194304 4785740 140736989686928 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 118549 114193 340 145 0 115594 0
[pid=957] ppid=953 vsize=461896 CPUtime=1654.15 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 165415 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 4962.4
Current children cumulated vsize (KiB) 3045028



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 3.00 3.45 4.59 4/175 1121
/proc/meminfo: memFree=27219260/32951124 swapFree=67051452/67111528
[pid=953] ppid=951 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/953/stat : 953 (ppfolio) S 951 953 32262 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 433969185 18763776 394 33554432000 4194304 4287625 140736623952800 18446744073709551615 218370977295 0 0 4096 65536 11669629278005231616 0 0 17 2 0 0 0
/proc/953/statm: 4581 394 345 23 0 91 0
[pid=954] ppid=953 vsize=2090612 CPUtime=1666.69 cores=0
/proc/954/stat : 954 (cryptominisat) R 953 953 32262 0 -1 4202496 1051314 0 0 0 166450 219 0 0 25 0 1 0 433969186 2140786688 36487 33554432000 4194304 4587354 140733998271456 18446744073709551615 4239312 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/954/statm: 522653 36487 337 96 0 519215 0
[pid=956] ppid=953 vsize=474196 CPUtime=1666.66 cores=0
/proc/956/stat : 956 (clasp) R 953 953 32262 0 -1 4202496 115539 0 0 0 166635 31 0 0 25 0 1 0 433969186 485576704 114193 33554432000 4194304 4785740 140736989686928 18446744073709551615 4553068 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/956/statm: 118549 114193 340 145 0 115594 0
[pid=957] ppid=953 vsize=461896 CPUtime=1666.75 cores=0
/proc/957/stat : 957 (TNM) R 953 953 32262 0 -1 4202496 4295 0 0 0 166675 0 0 0 25 0 1 0 433969186 472981504 4192 33554432000 134512640 134534564 4294059232 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/957/statm: 115474 4192 95 6 0 114140 0
Current children cumulated CPU time (s) 5000.1
Current children cumulated vsize (KiB) 3045028

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 953 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.002998
# while last known CPU time is 5000.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.01
CPU time (s): 5000.1
CPU user time (s): 4997.6
CPU system time (s): 2.5
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 5022448

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 501
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 265
involuntary context switches= 5

runsolver used 8.66468 second user time and 18.0982 second system time

The end

Launcher Data 

Begin job on node101 at 2011-04-19 16:34:24
IDJOB=3219232
IDBENCH=82555
IDSOLVER=1639
FILE ID=node101/3219232-1303223664
RUNJOBID= node101-1303203304-32280
PBS_JOBID= 13030636
Free space on /tmp= 72896 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v25000-c105000-S1838224332-006-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3219232-1303223664/watcher-3219232-1303223664 -o /tmp/evaluation-result-3219232-1303223664/solver-3219232-1303223664 -C 5000 -W 5000 -M 15500  ppfolio --nbcore=1 HOME/instance-3219232-1303223664.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a93695501183427990f531672c9572d2
RANDOM SEED=1848276996

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27742652 kB
Buffers:        257036 kB
Cached:        4644860 kB
SwapCached:      33620 kB
Active:        2358812 kB
Inactive:      2665228 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27742652 kB
SwapTotal:    67111528 kB
SwapFree:     67051452 kB
Dirty:           12060 kB
Writeback:           0 kB
AnonPages:      109596 kB
Mapped:          10528 kB
Slab:           120460 kB
PageTables:       5364 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1441800 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72896 MiB
End job on node101 at 2011-04-19 17:57:46