Trace number 3285857

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.13 1300.01

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
MD5SUM6c2d25eda70423643946d76935ceb950
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1512832
Number of clauses8233086
Sum of the clauses size19530286
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 28165680
Number of clauses of size 31280
Number of clauses of size 41600
Number of clauses of size 51600
Number of clauses of size over 562080

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 1
0.00/0.00

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3285857-1303763431/watcher-3285857-1303763431 -o /tmp/evaluation-result-3285857-1303763431/solver-3285857-1303763431 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3285857-1303763431.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.28 10.73 8.82 10/197 21142
/proc/meminfo: memFree=14357880/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18240 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) R 21140 21142 20445 0 -1 4194304 285 0 0 0 0 0 0 0 22 0 1 0 487944099 18677760 233 33554432000 4194304 4287625 140734432104176 18446744073709551615 244441982865 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/21142/statm: 4560 234 198 23 0 57 0

[startup+0.01831 s]
/proc/loadavg: 10.28 10.73 8.82 10/197 21142
/proc/meminfo: memFree=14357880/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 24 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 518785801148956672 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100299 s]
/proc/loadavg: 10.28 10.73 8.82 10/197 21142
/proc/meminfo: memFree=14357880/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 24 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 518785801148956672 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300262 s]
/proc/loadavg: 10.28 10.73 8.82 10/197 21142
/proc/meminfo: memFree=14357880/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 24 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 518785801148956672 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700183 s]
/proc/loadavg: 10.28 10.73 8.82 10/197 21142
/proc/meminfo: memFree=14357880/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 24 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 518785801148956672 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50105 s]
/proc/loadavg: 10.49 10.77 8.84 11/200 21146
/proc/meminfo: memFree=13941504/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 24 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 518785801148956672 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=203416 CPUtime=0.78 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 42542 0 0 0 72 6 0 0 25 0 1 0 487944100 208297984 41917 33554432000 4194304 4587354 140736935960480 18446744073709551615 244446606021 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 50854 41918 288 96 0 47416 0
[pid=21145] ppid=21142 vsize=236864 CPUtime=0.69 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 65265 0 0 0 60 9 0 0 25 0 1 0 487944100 242548736 54074 33554432000 4194304 4785740 140736449094848 18446744073709551615 4472568 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 59216 54074 309 145 0 56261 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 458604

[startup+3.10074 s]
/proc/loadavg: 10.49 10.77 8.84 11/200 21146
/proc/meminfo: memFree=13616392/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 24 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 518785801148956672 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=402728 CPUtime=1.58 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 89725 0 0 0 146 12 0 0 25 0 1 0 487944100 412393472 88559 33554432000 4194304 4587354 140736935960480 18446744073709551615 244446606021 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 100715 88560 288 96 0 97277 0
[pid=21145] ppid=21142 vsize=283956 CPUtime=1.49 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 76997 0 0 0 137 12 0 0 25 0 1 0 487944100 290770944 65806 33554432000 4194304 4785740 140736449094848 18446744073709551615 4450840 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 70989 65806 309 145 0 68034 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 705008

[startup+6.30115 s]
/proc/loadavg: 10.45 10.76 8.85 11/200 21146
/proc/meminfo: memFree=13064960/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 18 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 578409378965618688 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=758152 CPUtime=3.19 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 172307 0 0 0 294 25 0 0 25 0 1 0 487944100 776347648 170054 33554432000 4194304 4587354 140736935960480 18446744073709551615 244446606021 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 189538 170054 306 96 0 186100 0
[pid=21145] ppid=21142 vsize=341752 CPUtime=3.09 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 122385 0 0 0 290 19 0 0 25 0 1 0 487944100 349954048 81277 33554432000 4194304 4785740 140736449094848 18446744073709551615 4318843 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 85438 81277 321 145 0 82483 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1118228

[startup+12.701 s]
/proc/loadavg: 10.42 10.74 8.85 11/200 21146
/proc/meminfo: memFree=12462080/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=1006860 CPUtime=6.39 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 234292 0 0 0 607 32 0 0 25 0 1 0 487944100 1031024640 232039 33554432000 4194304 4587354 140736935960480 18446744073709551615 4365236 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 251715 232039 310 96 0 248277 0
[pid=21145] ppid=21142 vsize=351988 CPUtime=6.29 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 125089 0 0 0 609 20 0 0 25 0 1 0 487944100 360435712 83981 33554432000 4194304 4785740 140736449094848 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 87997 83981 329 145 0 85042 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1377172

[startup+25.5006 s]
/proc/loadavg: 10.35 10.72 8.86 11/200 21147
/proc/meminfo: memFree=12336196/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=1009840 CPUtime=12.79 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 235050 0 0 0 1247 32 0 0 25 0 1 0 487944100 1034076160 232797 33554432000 4194304 4587354 140736935960480 18446744073709551615 4430368 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 252460 232797 311 96 0 249022 0
[pid=21145] ppid=21142 vsize=371224 CPUtime=12.69 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 129917 0 0 0 1248 21 0 0 25 0 1 0 487944100 380133376 88809 33554432000 4194304 4785740 140736449094848 18446744073709551615 4319144 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 92806 88809 336 145 0 89851 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1399388

[startup+51.1008 s]
/proc/loadavg: 10.27 10.66 8.90 11/200 21148
/proc/meminfo: memFree=11573740/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 2481141695673008128 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=970660 CPUtime=25.59 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 244136 0 0 0 2525 34 0 0 25 0 1 0 487944100 993955840 227106 33554432000 4194304 4587354 140736935960480 18446744073709551615 4236680 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 242665 227106 325 96 0 239227 0
[pid=21145] ppid=21142 vsize=409016 CPUtime=25.48 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 139379 0 0 0 2525 23 0 0 25 0 1 0 487944100 418832384 98271 33554432000 4194304 4785740 140736449094848 18446744073709551615 4552662 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 102254 98271 336 145 0 99299 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 1398000

[startup+102.307 s]
/proc/loadavg: 10.12 10.56 8.96 11/200 21149
/proc/meminfo: memFree=11450096/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=1120664 CPUtime=51.18 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 255999 0 0 0 5082 36 0 0 25 0 1 0 487944100 1147559936 238966 33554432000 4194304 4587354 140736935960480 18446744073709551615 4236860 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 280166 238966 325 96 0 276728 0
[pid=21145] ppid=21142 vsize=429340 CPUtime=51.1 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 144452 0 0 0 5086 24 0 0 25 0 1 0 487944100 439644160 103344 33554432000 4194304 4785740 140736449094848 18446744073709551615 4290576 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 107335 103344 336 145 0 104380 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1568328

[startup+162.301 s]
/proc/loadavg: 10.04 10.45 9.02 11/200 21150
/proc/meminfo: memFree=11343932/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=1120664 CPUtime=81.18 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 265938 0 0 0 8080 38 0 0 25 0 1 0 487944100 1147559936 248901 33554432000 4194304 4587354 140736935960480 18446744073709551615 4236555 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 280166 248901 325 96 0 276728 0
[pid=21145] ppid=21142 vsize=451200 CPUtime=81.1 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 149927 0 0 0 8084 26 0 0 25 0 1 0 487944100 462028800 108819 33554432000 4194304 4785740 140736449094848 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 112800 108819 336 145 0 109845 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 1590188

[startup+222.301 s]
/proc/loadavg: 10.01 10.37 9.08 11/200 21152
/proc/meminfo: memFree=11152200/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 0 0 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=1120664 CPUtime=111.18 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 277604 0 0 0 11077 41 0 0 25 0 1 0 487944100 1147559936 260564 33554432000 4194304 4587354 140736935960480 18446744073709551615 4236896 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 280166 260564 325 96 0 276728 0
[pid=21145] ppid=21142 vsize=478628 CPUtime=111.11 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 156780 0 0 0 11083 28 0 0 25 0 1 0 487944100 490115072 115672 33554432000 4194304 4785740 140736449094848 18446744073709551615 4552626 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 119657 115672 336 145 0 116702 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 1617616

[startup+282.301 s]

################
# More data... #
################

/proc/meminfo: memFree=9837096/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.05 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 4 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3508552 CPUtime=445.17 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 17656042 0 0 0 42283 2234 0 0 18 0 1 0 487944100 3592757248 245910 33554432000 4194304 4587354 140736935960480 18446744073709551615 4502695 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 877138 245910 332 96 0 873700 0
[pid=21145] ppid=21142 vsize=607416 CPUtime=317.14 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 188939 0 0 0 31678 36 0 0 25 0 1 0 487944100 621993984 147831 33554432000 4194304 4785740 140736449094848 18446744073709551615 4561965 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 151854 147831 336 145 0 148899 0
Current children cumulated CPU time (s) 762.36
Current children cumulated vsize (KiB) 4134292

[startup+822.3 s]
/proc/loadavg: 10.00 10.04 9.50 11/200 21168
/proc/meminfo: memFree=9820192/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.06 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 5 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3508552 CPUtime=483.61 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 20161882 0 0 0 45818 2543 0 0 20 0 1 0 487944100 3592757248 245910 33554432000 4194304 4587354 140736935960480 18446744073709551615 4502763 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 877138 245910 332 96 0 873700 0
[pid=21145] ppid=21142 vsize=624532 CPUtime=338.68 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 193195 0 0 0 33831 37 0 0 25 0 1 0 487944100 639520768 152087 33554432000 4194304 4785740 140736449094848 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 156133 152087 336 145 0 153178 0
Current children cumulated CPU time (s) 822.35
Current children cumulated vsize (KiB) 4151408

[startup+882.3 s]
/proc/loadavg: 10.00 10.03 9.53 11/200 21170
/proc/meminfo: memFree=9624620/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.06 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 5 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3490096 CPUtime=523.21 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 22776384 0 0 0 49458 2863 0 0 23 0 1 0 487944100 3573858304 236372 33554432000 4194304 4587354 140736935960480 18446744073709551615 244446642625 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 872524 236372 332 96 0 869086 0
[pid=21145] ppid=21142 vsize=647928 CPUtime=359.09 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 199077 0 0 0 35871 38 0 0 25 0 1 0 487944100 663478272 157969 33554432000 4194304 4785740 140736449094848 18446744073709551615 4290655 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 161982 157969 336 145 0 159027 0
Current children cumulated CPU time (s) 882.36
Current children cumulated vsize (KiB) 4156348

[startup+942.301 s]
/proc/loadavg: 10.00 10.03 9.56 11/200 21171
/proc/meminfo: memFree=9707924/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.07 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 6 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3508552 CPUtime=560.87 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 25244482 0 0 0 52911 3176 0 0 18 0 1 0 487944100 3592757248 245910 33554432000 4194304 4587354 140736935960480 18446744073709551615 4502695 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 877138 245910 332 96 0 873700 0
[pid=21145] ppid=21142 vsize=662176 CPUtime=381.43 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 202645 0 0 0 38104 39 0 0 25 0 1 0 487944100 678068224 161537 33554432000 4194304 4785740 140736449094848 18446744073709551615 4416830 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 165544 161537 336 145 0 162589 0
Current children cumulated CPU time (s) 942.37
Current children cumulated vsize (KiB) 4189052

[startup+1002.3 s]
/proc/loadavg: 10.00 10.02 9.58 11/200 21173
/proc/meminfo: memFree=9660152/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.08 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 7 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3490096 CPUtime=602.8 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 27999762 0 0 0 56743 3537 0 0 19 0 1 0 487944100 3573858304 235310 33554432000 4194304 4587354 140736935960480 18446744073709551615 244446642503 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 872524 235310 332 96 0 869086 0
[pid=21145] ppid=21142 vsize=667508 CPUtime=399.51 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 203978 0 0 0 39911 40 0 0 25 0 1 0 487944100 683528192 162870 33554432000 4194304 4785740 140736449094848 18446744073709551615 4290648 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 166877 162870 336 145 0 163922 0
Current children cumulated CPU time (s) 1002.39
Current children cumulated vsize (KiB) 4175928

[startup+1062.3 s]
/proc/loadavg: 10.05 10.03 9.61 11/200 21174
/proc/meminfo: memFree=9523976/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.08 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 7 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3508552 CPUtime=644.39 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 30776242 0 0 0 60557 3882 0 0 20 0 1 0 487944100 3592757248 245910 33554432000 4194304 4587354 140736935960480 18446744073709551615 4507328 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 877138 245910 332 96 0 873700 0
[pid=21145] ppid=21142 vsize=678732 CPUtime=417.93 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 206775 0 0 0 41752 41 0 0 25 0 1 0 487944100 695021568 165667 33554432000 4194304 4785740 140736449094848 18446744073709551615 4290607 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 169683 165667 336 145 0 166728 0
Current children cumulated CPU time (s) 1062.4
Current children cumulated vsize (KiB) 4205608

[startup+1122.3 s]
/proc/loadavg: 10.02 10.02 9.63 11/200 21176
/proc/meminfo: memFree=9421880/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.09 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 8 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3490096 CPUtime=684.89 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 33419780 0 0 0 64283 4206 0 0 21 0 1 0 487944100 3573858304 241768 33554432000 4194304 4587354 140736935960480 18446744073709551615 4263354 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 872524 241768 332 96 0 869086 0
[pid=21145] ppid=21142 vsize=691204 CPUtime=437.42 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 209915 0 0 0 43701 41 0 0 25 0 1 0 487944100 707792896 168807 33554432000 4194304 4785740 140736449094848 18446744073709551615 4552608 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 172801 168807 336 145 0 169846 0
Current children cumulated CPU time (s) 1122.4
Current children cumulated vsize (KiB) 4199624

[startup+1182.3 s]
/proc/loadavg: 10.00 10.02 9.65 11/200 21178
/proc/meminfo: memFree=9193088/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.09 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 8 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3490096 CPUtime=721.8 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 35808179 0 0 0 67678 4502 0 0 20 0 1 0 487944100 3573858304 242527 33554432000 4194304 4587354 140736935960480 18446744073709551615 4263347 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 872524 242530 332 96 0 869086 0
[pid=21145] ppid=21142 vsize=702880 CPUtime=460.52 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 212826 0 0 0 46011 41 0 0 25 0 1 0 487944100 719749120 171718 33554432000 4194304 4785740 140736449094848 18446744073709551615 4290586 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 175720 171718 336 145 0 172765 0
Current children cumulated CPU time (s) 1182.41
Current children cumulated vsize (KiB) 4211300

[startup+1242.3 s]
/proc/loadavg: 10.00 10.01 9.67 11/200 21179
/proc/meminfo: memFree=8930792/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.1 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 1 9 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3508552 CPUtime=760.8 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 38341042 0 0 0 71261 4819 0 0 18 0 1 0 487944100 3592757248 245910 33554432000 4194304 4587354 140736935960480 18446744073709551615 4507634 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 877138 245910 332 96 0 873700 0
[pid=21145] ppid=21142 vsize=717856 CPUtime=481.51 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 216593 0 0 0 48109 42 0 0 25 0 1 0 487944100 735084544 175485 33554432000 4194304 4785740 140736449094848 18446744073709551615 4286930 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 179464 175485 336 145 0 176509 0
Current children cumulated CPU time (s) 1242.41
Current children cumulated vsize (KiB) 4244732



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.56 9.92 9.66 3/177 21235
/proc/meminfo: memFree=14587064/32951124 swapFree=67111528/67111528
[pid=21142] ppid=21140 vsize=18324 CPUtime=0.11 cores=1,3
/proc/21142/stat : 21142 (ppfolio) S 21140 21142 20445 0 -1 4202496 500 215 0 0 2 9 0 0 15 0 1 0 487944099 18763776 394 33554432000 4194304 4287625 140734432104176 18446744073709551615 244446965263 0 0 4096 65536 4294934791 0 0 17 3 0 0 0
/proc/21142/statm: 4581 394 346 23 0 91 0
[pid=21144] ppid=21142 vsize=3555832 CPUtime=796.37 cores=1
/proc/21144/stat : 21144 (cryptominisat) R 21142 21142 20445 0 -1 4202496 40640813 0 0 0 74530 5107 0 0 22 0 1 0 487944100 3641171968 252601 33554432000 4194304 4587354 140736935960480 18446744073709551615 4423587 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21144/statm: 888958 252601 332 96 0 885520 0
[pid=21145] ppid=21142 vsize=733464 CPUtime=503.65 cores=1
/proc/21145/stat : 21145 (clasp) R 21142 21142 20445 0 -1 4202496 220419 0 0 0 50322 43 0 0 25 0 1 0 487944100 751067136 179311 33554432000 4194304 4785740 140736449094848 18446744073709551615 4290588 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21145/statm: 183366 179311 336 145 0 180411 0
Current children cumulated CPU time (s) 1300.13
Current children cumulated vsize (KiB) 4307620

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21142 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=21996
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=98984
# CPU time returned by wait4() is 0.12098
# while last known CPU time is 1300.13
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300.13
CPU user time (s): 1248.54
CPU system time (s): 51.59
CPU usage (%): 100.009
Max. virtual memory (cumulated for all children) (KiB): 4400604

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.021996
system time used= 0.098984
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 715
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13966
involuntary context switches= 8

runsolver used 2.05369 second user time and 5.15322 second system time

The end

Launcher Data 

Begin job on node105 at 2011-04-25 22:30:37
IDJOB=3285857
IDBENCH=82404
IDSOLVER=1613
FILE ID=node105/3285857-1303763431
RUNJOBID= node105-1303762124-20934
PBS_JOBID= 13157144
Free space on /tmp= 71440 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.040-NOTKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3285857-1303763431/watcher-3285857-1303763431 -o /tmp/evaluation-result-3285857-1303763431/solver-3285857-1303763431 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3285857-1303763431.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 6c2d25eda70423643946d76935ceb950
RANDOM SEED=2126488354

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14358656 kB
Buffers:       2283688 kB
Cached:       14022964 kB
SwapCached:          0 kB
Active:       10486680 kB
Inactive:      7522628 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14358656 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          482472 kB
Writeback:           0 kB
AnonPages:     1702140 kB
Mapped:          17396 kB
Slab:           516308 kB
PageTables:       9260 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2785484 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71728 MiB
End job on node105 at 2011-04-25 22:52:19