Trace number 3286086

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4109.31 1300.01

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
MD5SUMc6d3480970bb2819448dd0a800a3cf1c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1134832
Number of clauses6175026
Sum of the clauses size14647926
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 26124260
Number of clauses of size 3960
Number of clauses of size 41200
Number of clauses of size 51200
Number of clauses of size over 546560

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7
0.00/0.00

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3286086-1304035266/watcher-3286086-1304035266 -o /tmp/evaluation-result-3286086-1304035266/solver-3286086-1304035266 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3286086-1304035266.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.78 9.43 9.53 5/181 8092
/proc/meminfo: memFree=13014944/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) R 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 25 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0

[startup+0.101892 s]
/proc/loadavg: 8.78 9.43 9.53 5/181 8092
/proc/meminfo: memFree=13014944/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) R 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 25 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200872 s]
/proc/loadavg: 8.78 9.43 9.53 5/181 8092
/proc/meminfo: memFree=13014944/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 25 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195742862639366 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300855 s]
/proc/loadavg: 8.78 9.43 9.53 5/181 8092
/proc/meminfo: memFree=13014944/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 25 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195742862639366 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700781 s]
/proc/loadavg: 8.78 9.43 9.53 5/181 8092
/proc/meminfo: memFree=13014944/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 25 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195742862639366 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50063 s]
/proc/loadavg: 8.78 9.43 9.53 9/186 8098
/proc/meminfo: memFree=12295580/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 25 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195742862639366 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=386984 CPUtime=1.49 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 83962 0 0 0 135 14 0 0 25 0 1 0 515127456 396271616 82800 33554432000 4194304 4587354 140737051938912 18446744073709551615 244446945024 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 96746 82800 288 96 0 93308 0
[pid=8094] ppid=8092 vsize=234036 CPUtime=1.48 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 62418 0 0 0 136 12 0 0 25 0 1 0 515127457 239652864 53996 33554432000 4194304 4785740 140734414659424 18446744073709551615 244446606021 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 58509 53996 309 145 0 55554 0
[pid=8096] ppid=8092 vsize=103820 CPUtime=1.48 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 25327 0 0 0 141 7 0 0 25 0 1 0 515127457 106311680 25123 33554432000 4194304 4352236 140734779648496 18446744073709551615 244446945024 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 25955 25123 101 39 0 25035 0
[pid=8097] ppid=8092 vsize=275920 CPUtime=1.48 cores=7
/proc/8097/stat : 8097 (march_hi) R 8092 8092 7235 0 -1 4194304 62918 0 0 0 137 11 0 0 25 0 1 0 515127457 282542080 62813 33554432000 4194304 4331988 140736717236112 18446744073709551615 244446612447 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/8097/statm: 68980 62813 113 34 0 67422 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 1019084

[startup+3.10034 s]
/proc/loadavg: 8.72 9.41 9.52 9/186 8098
/proc/meminfo: memFree=11851864/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 18 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195738567704576 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=553388 CPUtime=3.09 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 128159 0 0 0 287 22 0 0 25 0 1 0 515127456 566669312 125939 33554432000 4194304 4587354 140737051938912 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 138347 125939 306 96 0 134909 0
[pid=8094] ppid=8092 vsize=259716 CPUtime=3.09 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 92102 0 0 0 292 17 0 0 25 0 1 0 515127457 265949184 61237 33554432000 4194304 4785740 140734414659424 18446744073709551615 4552628 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 64929 61237 328 145 0 61974 0
[pid=8096] ppid=8092 vsize=148120 CPUtime=3.09 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 50871 0 0 0 295 14 0 0 25 0 1 0 515127457 151674880 36204 33554432000 4194304 4352236 140734779648496 18446744073709551615 4235610 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 37030 36204 107 39 0 36110 0
[pid=8097] ppid=8092 vsize=369908 CPUtime=3.07 cores=7
/proc/8097/stat : 8097 (march_hi) R 8092 8092 7235 0 -1 4194304 89254 0 0 0 288 19 0 0 25 0 1 0 515127457 378785792 89149 33554432000 4194304 4331988 140736717236112 18446744073709551615 244446493231 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/8097/statm: 92477 89149 113 34 0 90919 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 1349456

[startup+6.30074 s]
/proc/loadavg: 8.72 9.41 9.52 9/186 8098
/proc/meminfo: memFree=11385868/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195742862639366 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=725484 CPUtime=6.29 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 171170 0 0 0 602 27 0 0 25 0 1 0 515127456 742895616 168950 33554432000 4194304 4587354 140737051938912 18446744073709551615 4365236 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 181371 168950 310 96 0 177933 0
[pid=8094] ppid=8092 vsize=269920 CPUtime=6.27 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 94665 0 0 0 610 17 0 0 25 0 1 0 515127457 276398080 63800 33554432000 4194304 4785740 140734414659424 18446744073709551615 244446606021 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 67480 63800 336 145 0 64525 0
[pid=8096] ppid=8092 vsize=170008 CPUtime=6.29 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 109405 0 0 0 608 21 0 0 25 0 1 0 515127457 174088192 41654 33554432000 4194304 4352236 140734779648496 18446744073709551615 4257350 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 42502 41654 117 39 0 41582 0
[pid=8097] ppid=8092 vsize=908404 CPUtime=6.26 cores=7
/proc/8097/stat : 8097 (march_hi) R 8092 8092 7235 0 -1 4194304 164317 0 0 0 593 33 0 0 25 0 1 0 515127457 930205696 164209 33554432000 4194304 4331988 140736717236112 18446744073709551615 4251608 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/8097/statm: 227101 164209 117 34 0 225543 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 2092140

[startup+12.7005 s]
/proc/loadavg: 8.69 9.38 9.51 9/186 8098
/proc/meminfo: memFree=11266696/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195742862639366 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=816148 CPUtime=12.68 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 193382 0 0 0 1238 30 0 0 25 0 1 0 515127456 835735552 182296 33554432000 4194304 4587354 140737051938912 18446744073709551615 4356696 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 204037 182297 314 96 0 200599 0
[pid=8094] ppid=8092 vsize=302012 CPUtime=12.68 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 102685 0 0 0 1249 19 0 0 25 0 1 0 515127457 309260288 71820 33554432000 4194304 4785740 140734414659424 18446744073709551615 4552553 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 75503 71820 336 145 0 72548 0
[pid=8096] ppid=8092 vsize=266284 CPUtime=12.68 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 133478 0 0 0 1244 24 0 0 25 0 1 0 515127457 272674816 65727 33554432000 4194304 4352236 140734779648496 18446744073709551615 4284123 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 66571 65727 121 39 0 65651 0
[pid=8097] ppid=8092 vsize=801724 CPUtime=12.62 cores=7
/proc/8097/stat : 8097 (march_hi) R 8092 8092 7235 0 -1 4194304 273239 0 0 0 1213 49 0 0 25 0 1 0 515127457 820965376 131816 33554432000 4194304 4331988 140736717236112 18446744073709551615 244446340542 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/8097/statm: 200431 131816 129 34 0 198873 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 2204492

[startup+25.5012 s]
/proc/loadavg: 8.58 9.33 9.49 9/186 8099
/proc/meminfo: memFree=10909208/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195738567704576 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1067436 CPUtime=25.49 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 348904 0 0 0 2496 53 0 0 25 0 1 0 515127456 1093054464 241480 33554432000 4194304 4587354 140737051938912 18446744073709551615 4236694 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 266859 241480 330 96 0 263421 0
[pid=8094] ppid=8092 vsize=329392 CPUtime=25.48 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 109509 0 0 0 2527 21 0 0 25 0 1 0 515127457 337297408 78644 33554432000 4194304 4785740 140734414659424 18446744073709551615 4290576 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 82348 78644 336 145 0 79393 0
[pid=8096] ppid=8092 vsize=266284 CPUtime=25.48 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 133488 0 0 0 2524 24 0 0 25 0 1 0 515127457 272674816 65737 33554432000 4194304 4352236 140734779648496 18446744073709551615 4228658 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 66571 65737 125 39 0 65651 0
[pid=8097] ppid=8092 vsize=795564 CPUtime=25.35 cores=7
/proc/8097/stat : 8097 (march_hi) R 8092 8092 7235 0 -1 4194304 546466 0 0 0 2449 86 0 0 25 0 1 0 515127457 814657536 137152 33554432000 4194304 4331988 140736717236112 18446744073709551615 4256845 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/8097/statm: 198891 137152 129 34 0 197333 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 2477000

[startup+51.1004 s]
/proc/loadavg: 8.45 9.24 9.46 9/186 8099
/proc/meminfo: memFree=10741912/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195742862639366 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1217440 CPUtime=51.09 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 350663 0 0 0 5055 54 0 0 25 0 1 0 515127456 1246658560 243236 33554432000 4194304 4587354 140737051938912 18446744073709551615 4236561 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 304360 243236 330 96 0 300922 0
[pid=8094] ppid=8092 vsize=366708 CPUtime=51.07 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 118833 0 0 0 5085 22 0 0 25 0 1 0 515127457 375508992 87968 33554432000 4194304 4785740 140734414659424 18446744073709551615 4290607 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 91677 87968 336 145 0 88722 0
[pid=8096] ppid=8092 vsize=274524 CPUtime=51.09 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 135923 0 0 0 5084 25 0 0 25 0 1 0 515127457 281112576 67799 33554432000 4194304 4352236 140734779648496 18446744073709551615 4327857 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 68631 67799 127 39 0 67711 0
[pid=8097] ppid=8092 vsize=795004 CPUtime=50.81 cores=7
/proc/8097/stat : 8097 (march_hi) R 8092 8092 7235 0 -1 4194304 1013843 0 0 0 4928 153 0 0 25 0 1 0 515127457 814084096 137012 33554432000 4194304 4331988 140736717236112 18446744073709551615 4256850 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/8097/statm: 198751 137012 129 34 0 197193 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 2672000

[startup+102.301 s]
/proc/loadavg: 8.25 9.04 9.37 9/186 8101
/proc/meminfo: memFree=10584676/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 214 0 0 0 0 0 0 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 9224195742862639366 0 0 17 5 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1217440 CPUtime=102.29 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 375124 0 0 0 10170 59 0 0 25 0 1 0 515127456 1246658560 267695 33554432000 4194304 4587354 140737051938912 18446744073709551615 4236694 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 304360 267695 330 96 0 300922 0
[pid=8094] ppid=8092 vsize=384572 CPUtime=102.28 cores=5

################
# More data... #
################

/proc/8096/statm: 70957 68078 127 39 0 70037 0
Current children cumulated CPU time (s) 2856.1
Current children cumulated vsize (KiB) 2447600

[startup+942.301 s]
/proc/loadavg: 8.07 8.16 8.61 9/186 8254
/proc/meminfo: memFree=10585900/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=209.18 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 2527176 0 0 1 14 20300 603 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 6315279917302939648 0 0 17 7 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1365932 CPUtime=942.31 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 69599882 0 0 0 85123 9108 0 0 20 0 1 0 515127456 1398714368 269971 33554432000 4194304 4587354 140737051938912 18446744073709551615 4502695 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 341483 269971 335 96 0 338045 0
[pid=8094] ppid=8092 vsize=808152 CPUtime=942.29 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 229052 0 0 0 94174 55 0 0 25 0 1 0 515127457 827547648 198187 33554432000 4194304 4785740 140734414659424 18446744073709551615 4562683 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 202038 198187 336 145 0 199083 0
[pid=8096] ppid=8092 vsize=283828 CPUtime=942.32 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 241387 0 0 0 94194 38 0 0 25 0 1 0 515127457 290639872 68664 33554432000 4194304 4352236 140734779648496 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 70957 68664 127 39 0 70037 0
Current children cumulated CPU time (s) 3036.1
Current children cumulated vsize (KiB) 2476236

[startup+1002.3 s]
/proc/loadavg: 8.07 8.15 8.58 9/186 8256
/proc/meminfo: memFree=10552008/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=209.19 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 2527176 0 0 1 15 20300 603 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 6315279504986079232 0 0 17 7 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1401396 CPUtime=1002.31 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 75563237 0 0 0 90361 9870 0 0 18 0 1 0 515127456 1435029504 272626 33554432000 4194304 4587354 140737051938912 18446744073709551615 4423566 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 350349 272638 335 96 0 346911 0
[pid=8094] ppid=8092 vsize=837332 CPUtime=1002.3 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 236352 0 0 0 100173 57 0 0 25 0 1 0 515127457 857427968 205487 33554432000 4194304 4785740 140734414659424 18446744073709551615 4552626 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 209333 205487 336 145 0 206378 0
[pid=8096] ppid=8092 vsize=283628 CPUtime=1002.32 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 241387 0 0 0 100194 38 0 0 25 0 1 0 515127457 290435072 68614 33554432000 4194304 4352236 140734779648496 18446744073709551615 4328030 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 70907 68614 127 39 0 69987 0
Current children cumulated CPU time (s) 3216.12
Current children cumulated vsize (KiB) 2540680

[startup+1062.3 s]
/proc/loadavg: 8.06 8.13 8.54 9/186 8257
/proc/meminfo: memFree=10464908/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=209.19 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 2527176 0 0 1 15 20300 603 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 6315278268035497984 0 0 17 7 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1365932 CPUtime=1062.31 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 81562381 0 0 0 95596 10635 0 0 18 0 1 0 515127456 1398714368 269984 33554432000 4194304 4587354 140737051938912 18446744073709551615 244446969751 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 341483 269984 335 96 0 338045 0
[pid=8094] ppid=8092 vsize=883972 CPUtime=1062.31 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 248055 0 0 0 106169 62 0 0 25 0 1 0 515127457 905187328 217190 33554432000 4194304 4785740 140734414659424 18446744073709551615 4290592 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 220993 217190 336 145 0 218038 0
[pid=8096] ppid=8092 vsize=283624 CPUtime=1062.32 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 241387 0 0 0 106194 38 0 0 25 0 1 0 515127457 290430976 68613 33554432000 4194304 4352236 140734779648496 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 70906 68613 127 39 0 69986 0
Current children cumulated CPU time (s) 3396.13
Current children cumulated vsize (KiB) 2551852

[startup+1122.3 s]
/proc/loadavg: 8.06 8.12 8.51 9/186 8259
/proc/meminfo: memFree=10451228/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=209.21 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 2527176 0 0 2 16 20300 603 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 6315278268035497984 0 0 17 7 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1304412 CPUtime=1122.31 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 87594577 0 0 0 100819 11412 0 0 18 0 1 0 515127456 1335717888 253686 33554432000 4194304 4587354 140737051938912 18446744073709551615 4263347 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 326103 253691 335 96 0 322665 0
[pid=8094] ppid=8092 vsize=900940 CPUtime=1122.3 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 252309 0 0 0 112167 63 0 0 25 0 1 0 515127457 922562560 221444 33554432000 4194304 4785740 140734414659424 18446744073709551615 4290648 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 225235 221444 336 145 0 222280 0
[pid=8096] ppid=8092 vsize=283400 CPUtime=1122.32 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 258802 0 0 0 112192 40 0 0 25 0 1 0 515127457 290201600 69587 33554432000 4194304 4352236 140734779648496 18446744073709551615 4234513 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 70850 69587 127 39 0 69930 0
Current children cumulated CPU time (s) 3576.14
Current children cumulated vsize (KiB) 2507076

[startup+1182.3 s]
/proc/loadavg: 8.13 8.12 8.49 10/186 8261
/proc/meminfo: memFree=10388688/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=209.23 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 2527176 0 0 2 18 20300 603 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 6315280192180846592 0 0 17 7 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1329020 CPUtime=1182.31 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 93656979 0 0 0 106035 12196 0 0 18 0 1 0 515127456 1360916480 258728 33554432000 4194304 4587354 140737051938912 18446744073709551615 4263347 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 332255 258733 335 96 0 328817 0
[pid=8094] ppid=8092 vsize=918916 CPUtime=1182.31 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 256805 0 0 0 118167 64 0 0 25 0 1 0 515127457 940969984 225940 33554432000 4194304 4785740 140734414659424 18446744073709551615 4290576 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 229729 225940 336 145 0 226774 0
[pid=8096] ppid=8092 vsize=285792 CPUtime=1182.32 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 259831 0 0 0 118192 40 0 0 25 0 1 0 515127457 292651008 70616 33554432000 4194304 4352236 140734779648496 18446744073709551615 4207615 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 71448 70616 127 39 0 70528 0
Current children cumulated CPU time (s) 3756.17
Current children cumulated vsize (KiB) 2552052

[startup+1242.3 s]
/proc/loadavg: 8.15 8.13 8.46 9/186 8262
/proc/meminfo: memFree=10343996/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=209.23 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 2527176 0 0 2 18 20300 603 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 6315279917302939648 0 0 17 7 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1365932 CPUtime=1242.31 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 100015579 0 0 0 111231 13000 0 0 18 0 1 0 515127456 1398714368 269988 33554432000 4194304 4587354 140737051938912 18446744073709551615 4502695 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 341483 269988 335 96 0 338045 0
[pid=8094] ppid=8092 vsize=945320 CPUtime=1242.31 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 263419 0 0 0 124165 66 0 0 25 0 1 0 515127457 968007680 232554 33554432000 4194304 4785740 140734414659424 18446744073709551615 4290583 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 236330 232554 336 145 0 233375 0
[pid=8096] ppid=8092 vsize=285792 CPUtime=1242.33 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 259831 0 0 0 124193 40 0 0 25 0 1 0 515127457 292651008 70616 33554432000 4194304 4352236 140734779648496 18446744073709551615 4208923 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 71448 70616 127 39 0 70528 0
Current children cumulated CPU time (s) 3936.18
Current children cumulated vsize (KiB) 2615368



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 8.13 8.12 8.44 9/186 8264
/proc/meminfo: memFree=10299816/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=209.24 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 2527176 0 0 2 19 20300 603 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 6315280192180846592 0 0 17 7 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1365932 CPUtime=1300.02 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 105847399 0 0 0 116252 13750 0 0 18 0 1 0 515127456 1398714368 269988 33554432000 4194304 4587354 140737051938912 18446744073709551615 4294208 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 341483 269988 335 96 0 338045 0
[pid=8094] ppid=8092 vsize=976916 CPUtime=1300.02 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 271321 0 0 0 129934 68 0 0 25 0 1 0 515127457 1000361984 240456 33554432000 4194304 4785740 140734414659424 18446744073709551615 4290651 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 244229 240456 336 145 0 241274 0
[pid=8096] ppid=8092 vsize=287808 CPUtime=1300.03 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 260335 0 0 0 129963 40 0 0 25 0 1 0 515127457 294715392 71120 33554432000 4194304 4352236 140734779648496 18446744073709551615 4238648 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 71952 71120 127 39 0 71032 0
Current children cumulated CPU time (s) 4109.31
Current children cumulated vsize (KiB) 2648980

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 8.13 8.12 8.44 9/186 8264
/proc/meminfo: memFree=10299816/32951124 swapFree=67111528/67111528
[pid=8092] ppid=8090 vsize=18324 CPUtime=209.24 cores=1,3,5,7
/proc/8092/stat : 8092 (ppfolio) S 8090 8092 7235 0 -1 4202496 521 2527176 0 0 2 19 20300 603 15 0 1 0 515127456 18763776 390 33554432000 4194304 4287625 140734267539376 18446744073709551615 244446965263 0 0 4096 65536 6315280192180846592 0 0 17 7 0 0 0
/proc/8092/statm: 4581 390 342 23 0 91 0
[pid=8093] ppid=8092 vsize=1365932 CPUtime=1300.02 cores=1
/proc/8093/stat : 8093 (cryptominisat) R 8092 8092 7235 0 -1 4202496 105847399 0 0 0 116252 13750 0 0 18 0 1 0 515127456 1398714368 269988 33554432000 4194304 4587354 140737051938912 18446744073709551615 4294208 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/8093/statm: 341483 269988 335 96 0 338045 0
[pid=8094] ppid=8092 vsize=976916 CPUtime=1300.02 cores=5
/proc/8094/stat : 8094 (clasp) R 8092 8092 7235 0 -1 4202496 271321 0 0 0 129934 68 0 0 25 0 1 0 515127457 1000361984 240456 33554432000 4194304 4785740 140734414659424 18446744073709551615 4290651 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/8094/statm: 244229 240456 336 145 0 241274 0
[pid=8096] ppid=8092 vsize=287808 CPUtime=1300.03 cores=3
/proc/8096/stat : 8096 (lingeling) R 8092 8092 7235 0 -1 4202496 260335 0 0 0 129963 40 0 0 25 0 1 0 515127457 294715392 71120 33554432000 4194304 4352236 140734779648496 18446744073709551615 4238648 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/8096/statm: 71952 71120 127 39 0 71032 0
Current children cumulated CPU time (s) 4109.31
Current children cumulated vsize (KiB) 2648980

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8092 and gives
#  childrusage.ru_utime.tv_sec=203
#  childrusage.ru_utime.tv_usec=28135
#  childrusage.ru_stime.tv_sec=6
#  childrusage.ru_stime.tv_usec=230052
# CPU time returned by wait4() is 209.258
# while last known CPU time is 4109.31
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 4109.31
CPU user time (s): 3964.51
CPU system time (s): 144.8
CPU usage (%): 316.098
Max. virtual memory (cumulated for all children) (KiB): 4701896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 203.028
system time used= 6.23005
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2527697
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23151
involuntary context switches= 2408

runsolver used 1.88571 second user time and 5.21721 second system time

The end

Launcher Data 

Begin job on node105 at 2011-04-29 02:01:10
IDJOB=3286086
IDBENCH=82413
IDSOLVER=1612
FILE ID=node105/3286086-1304035266
RUNJOBID= node105-1304028688-7255
PBS_JOBID= 13170347
Free space on /tmp= 71716 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3286086-1304035266/watcher-3286086-1304035266 -o /tmp/evaluation-result-3286086-1304035266/solver-3286086-1304035266 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3286086-1304035266.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c6d3480970bb2819448dd0a800a3cf1c
RANDOM SEED=928232243

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13015100 kB
Buffers:       2297468 kB
Cached:       14631520 kB
SwapCached:          0 kB
Active:       11485244 kB
Inactive:      7870892 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13015100 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          130756 kB
Writeback:           0 kB
AnonPages:     2426680 kB
Mapped:          16312 kB
Slab:           511032 kB
PageTables:       9532 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  3860976 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 70252 MiB
End job on node105 at 2011-04-29 02:22:52