Trace number 3265649

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 3896.98 1300.01

General information on the benchmark

NameSAT05/crafted/sorge05/QG7a/
gensys-ukn009.shuffled-as.sat05-3849.cnf
MD5SUMf2a1eb7937a7cda114ce344a30ca1145
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark824.93
Satisfiable
(Un)Satisfiability was proved
Number of variables2969
Number of clauses18718
Sum of the clauses size134151
Maximum clause length13
Minimum clause length1
Number of clauses of size 142
Number of clauses of size 2435
Number of clauses of size 32341
Number of clauses of size 4498
Number of clauses of size 5677
Number of clauses of size over 514725

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7
3896.98/1300.00	Done

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265649-1304096344/watcher-3265649-1304096344 -o /tmp/evaluation-result-3265649-1304096344/solver-3265649-1304096344 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3265649-1304096344.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.38 3.99 5.23 2/176 2089
/proc/meminfo: memFree=31042840/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=2712 CPUtime=0 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) D 2085 2089 2052 0 -1 4194304 82 0 1 0 0 0 0 0 17 0 1 0 521235170 2777088 36 33554432000 4194304 4287625 140733608406192 18446744073709551615 222916855218 0 0 4096 0 18446744071562234166 0 0 17 7 0 0 0
/proc/2089/statm: 678 36 26 23 0 23 0

[startup+0.812209 s]
/proc/loadavg: 3.38 3.99 5.23 2/176 2089
/proc/meminfo: memFree=31042840/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) R 2085 2089 2052 0 -1 4202496 516 0 2 0 0 0 0 0 21 0 1 0 521235170 18763776 389 33554432000 4194304 4287625 140733608406192 18446744073709551615 222916808194 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/2089/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.900194 s]
/proc/loadavg: 3.38 3.99 5.23 2/176 2089
/proc/meminfo: memFree=31042840/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 517 0 2 0 0 0 0 0 21 0 1 0 521235170 18763776 389 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4594366927878488063 0 0 17 5 0 0 0
/proc/2089/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.00018 s]
/proc/loadavg: 3.38 3.99 5.23 2/176 2089
/proc/meminfo: memFree=31042840/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) R 2085 2089 2052 0 -1 4202496 517 0 2 0 0 0 0 0 20 0 1 0 521235170 18763776 389 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/2089/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.10016 s]
/proc/loadavg: 3.38 3.99 5.23 2/176 2089
/proc/meminfo: memFree=31042840/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 517 0 2 0 0 0 0 0 20 0 1 0 521235170 18763776 389 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4594366927878488063 0 0 17 5 0 0 0
/proc/2089/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50108 s]
/proc/loadavg: 3.38 3.99 5.23 2/176 2089
/proc/meminfo: memFree=31042840/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 517 0 2 0 0 0 0 0 17 0 1 0 521235170 18763776 389 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4594366927878488063 0 0 17 5 0 0 0
/proc/2089/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10079 s]
/proc/loadavg: 3.38 3.99 5.23 11/188 2134
/proc/meminfo: memFree=30964972/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 521235170 18763776 389 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4594366927878488063 0 0 17 5 0 0 0
/proc/2089/statm: 4581 389 341 23 0 91 0
[pid=2092] ppid=2089 vsize=1204420 CPUtime=3.09 cores=1
/proc/2092/stat : 2092 (cryptominisat) R 2089 2089 2052 0 -1 4202496 6057 0 0 0 308 1 0 0 25 0 1 0 521235171 1233326080 3553 33554432000 4194304 4587354 140734870936272 18446744073709551615 4241101 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2092/statm: 301105 3553 338 96 0 297667 0
[pid=2094] ppid=2089 vsize=18636 CPUtime=3.08 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 2222 0 0 0 308 0 0 0 25 0 1 0 521235171 19083264 2014 33554432000 4194304 4785740 140733673669168 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 4659 2014 340 145 0 1704 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=1.07 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 107 0 0 0 23 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=10944 CPUtime=3.08 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 2559 0 0 0 308 0 0 0 25 0 1 0 521235171 11206656 1937 33554432000 4194304 4352236 140734142639824 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 2736 1937 127 39 0 1816 0
[pid=2099] ppid=2089 vsize=27044 CPUtime=1.99 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 12193 0 0 0 199 0 0 0 21 0 1 0 521235171 27693056 4128 33554432000 4194304 4331988 140735771417168 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 6761 4128 175 34 0 5203 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 1734276

[startup+6.3072 s]
/proc/loadavg: 3.91 4.09 5.25 10/187 2134
/proc/meminfo: memFree=30956456/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=19880 CPUtime=6.29 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 2494 0 0 0 629 0 0 0 25 0 1 0 521235171 20357120 2286 33554432000 4194304 4785740 140733673669168 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 4970 2286 340 145 0 2015 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=2.66 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 266 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134528934 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=11108 CPUtime=6.29 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 3104 0 0 0 629 0 0 0 25 0 1 0 521235171 11374592 1978 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328363 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 2777 1978 127 39 0 1857 0
[pid=2099] ppid=2089 vsize=27044 CPUtime=3.59 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 12210 0 0 0 359 0 0 0 25 0 1 0 521235171 27693056 4145 33554432000 4194304 4331988 140735771417168 18446744073709551615 4287103 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 6761 4145 175 34 0 5203 0
Current children cumulated CPU time (s) 22.87
Current children cumulated vsize (KiB) 531264

[startup+12.701 s]
/proc/loadavg: 4.23 4.16 5.27 9/186 2134
/proc/meminfo: memFree=30963556/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=21292 CPUtime=12.68 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 2865 0 0 0 1268 0 0 0 25 0 1 0 521235171 21803008 2657 33554432000 4194304 4785740 140733673669168 18446744073709551615 4287092 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 5323 2657 340 145 0 2368 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=5.82 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 582 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=12516 CPUtime=12.68 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 5181 0 0 0 1268 0 0 0 25 0 1 0 521235171 12816384 2330 33554432000 4194304 4352236 140734142639824 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 3129 2330 127 39 0 2209 0
[pid=2099] ppid=2089 vsize=27284 CPUtime=6.79 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 12232 0 0 0 679 0 0 0 25 0 1 0 521235171 27938816 4167 33554432000 4194304 4331988 140735771417168 18446744073709551615 4299358 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 6821 4167 175 34 0 5263 0
Current children cumulated CPU time (s) 42.01
Current children cumulated vsize (KiB) 534324

[startup+25.5007 s]
/proc/loadavg: 5.07 4.34 5.31 9/186 2134
/proc/meminfo: memFree=30954528/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=23460 CPUtime=25.48 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 3392 0 0 0 2548 0 0 0 25 0 1 0 521235171 24023040 3184 33554432000 4194304 4785740 140733673669168 18446744073709551615 4278093 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 5865 3184 340 145 0 2910 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=12.2 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 1220 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134530339 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=16524 CPUtime=25.48 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 7678 0 0 0 2548 0 0 0 25 0 1 0 521235171 16920576 3332 33554432000 4194304 4352236 140734142639824 18446744073709551615 4329077 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 4131 3332 127 39 0 3211 0
[pid=2099] ppid=2089 vsize=27284 CPUtime=13.13 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 12270 0 0 0 1313 0 0 0 25 0 1 0 521235171 27938816 4205 33554432000 4194304 4331988 140735771417168 18446744073709551615 4265456 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 6821 4205 175 34 0 5263 0
Current children cumulated CPU time (s) 80.33
Current children cumulated vsize (KiB) 540500

[startup+51.101 s]
/proc/loadavg: 6.21 4.67 5.39 9/186 2135
/proc/meminfo: memFree=30949124/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=26432 CPUtime=51.08 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 4064 0 0 0 5108 0 0 0 25 0 1 0 521235171 27066368 3856 33554432000 4194304 4785740 140733673669168 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 6608 3856 340 145 0 3653 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=24.92 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 2492 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134530166 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=15248 CPUtime=51.08 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 11793 0 0 0 5107 1 0 0 25 0 1 0 521235171 15613952 2985 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328377 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 3812 2985 127 39 0 2892 0
[pid=2099] ppid=2089 vsize=27820 CPUtime=25.88 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 12322 0 0 0 2588 0 0 0 25 0 1 0 521235171 28487680 4257 33554432000 4194304 4331988 140735771417168 18446744073709551615 4299282 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 6955 4257 175 34 0 5397 0
Current children cumulated CPU time (s) 157
Current children cumulated vsize (KiB) 542732

[startup+102.301 s]
/proc/loadavg: 7.22 5.18 5.53 9/186 2136
/proc/meminfo: memFree=30930752/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=30140 CPUtime=102.28 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 4907 0 0 0 10227 1 0 0 25 0 1 0 521235171 30863360 4699 33554432000 4194304 4785740 140733673669168 18446744073709551615 4286973 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 7535 4699 340 145 0 4580 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=50.4 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 5040 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=22020 CPUtime=102.28 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 20706 0 0 0 10226 2 0 0 25 0 1 0 521235171 22548480 4706 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328210 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 5505 4706 127 39 0 4585 0
[pid=2099] ppid=2089 vsize=28764 CPUtime=51.33 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 12435 0 0 0 5132 1 0 0 25 0 1 0 521235171 29454336 4370 33554432000 4194304 4331988 140735771417168 18446744073709551615 4299107 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 7191 4370 175 34 0 5633 0
Current children cumulated CPU time (s) 310.33

################
# More data... #
################


[startup+942.301 s]
/proc/loadavg: 8.25 8.00 7.08 9/186 2171
/proc/meminfo: memFree=30857240/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=49232 CPUtime=942.3 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 9327 0 0 0 94228 2 0 0 25 0 1 0 521235171 50413568 9119 33554432000 4194304 4785740 140733673669168 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 12308 9119 340 145 0 9353 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=468.13 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 46813 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=31140 CPUtime=942.31 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 107690 0 0 0 94216 15 0 0 25 0 1 0 521235171 31887360 6986 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 7785 6986 127 39 0 6865 0
[pid=2099] ppid=2089 vsize=36528 CPUtime=469.03 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 13922 0 0 0 46901 2 0 0 25 0 1 0 521235171 37404672 5857 33554432000 4194304 4331988 140735771417168 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 9132 5857 175 34 0 7574 0
Current children cumulated CPU time (s) 2825.81
Current children cumulated vsize (KiB) 590132

[startup+1002.3 s]
/proc/loadavg: 8.27 8.04 7.15 9/186 2172
/proc/meminfo: memFree=30846172/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=50448 CPUtime=1002.3 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 9570 0 0 0 100228 2 0 0 25 0 1 0 521235171 51658752 9362 33554432000 4194304 4785740 140733673669168 18446744073709551615 4287011 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 12612 9362 340 145 0 9657 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=497.93 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 49793 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=39332 CPUtime=1002.31 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 113194 0 0 0 100215 16 0 0 25 0 1 0 521235171 40275968 9034 33554432000 4194304 4352236 140734142639824 18446744073709551615 4329060 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 9833 9034 127 39 0 8913 0
[pid=2099] ppid=2089 vsize=36528 CPUtime=498.89 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 13981 0 0 0 49887 2 0 0 25 0 1 0 521235171 37404672 5916 33554432000 4194304 4331988 140735771417168 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 9132 5916 175 34 0 7574 0
Current children cumulated CPU time (s) 3005.47
Current children cumulated vsize (KiB) 599540

[startup+1062.31 s]
/proc/loadavg: 8.23 8.06 7.21 6/179 2183
/proc/meminfo: memFree=30948824/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=50700 CPUtime=1062.31 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 9631 0 0 0 106229 2 0 0 25 0 1 0 521235171 51916800 9423 33554432000 4194304 4785740 140733673669168 18446744073709551615 4553440 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 12675 9423 340 145 0 9720 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=527.78 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 52778 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=31468 CPUtime=1062.31 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 116972 0 0 0 106215 16 0 0 25 0 1 0 521235171 32223232 7068 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 7867 7068 127 39 0 6947 0
[pid=2099] ppid=2089 vsize=36528 CPUtime=528.72 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 14089 0 0 0 52870 2 0 0 25 0 1 0 521235171 37404672 6024 33554432000 4194304 4331988 140735771417168 18446744073709551615 4287586 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 9132 6024 175 34 0 7574 0
Current children cumulated CPU time (s) 3185.16
Current children cumulated vsize (KiB) 591928

[startup+1122.3 s]
/proc/loadavg: 8.16 8.08 7.27 9/186 2207
/proc/meminfo: memFree=30911644/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=51572 CPUtime=1122.3 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 9835 0 0 0 112228 2 0 0 25 0 1 0 521235171 52809728 9627 33554432000 4194304 4785740 140733673669168 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 12893 9627 340 145 0 9938 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=557.62 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 55762 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=36844 CPUtime=1122.32 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 122060 0 0 0 112215 17 0 0 25 0 1 0 521235171 37728256 8412 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328208 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 9211 8412 127 39 0 8291 0
[pid=2099] ppid=2089 vsize=36528 CPUtime=558.55 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 14161 0 0 0 55853 2 0 0 25 0 1 0 521235171 37404672 6096 33554432000 4194304 4331988 140735771417168 18446744073709551615 222921172237 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 9132 6096 175 34 0 7574 0
Current children cumulated CPU time (s) 3364.83
Current children cumulated vsize (KiB) 598176

[startup+1182.3 s]
/proc/loadavg: 8.17 8.09 7.32 9/186 2209
/proc/meminfo: memFree=30900068/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=52668 CPUtime=1182.3 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 10083 0 0 0 118228 2 0 0 25 0 1 0 521235171 53932032 9875 33554432000 4194304 4785740 140733673669168 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 13167 9875 340 145 0 10212 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=587.43 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 58743 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=35620 CPUtime=1182.31 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 125868 0 0 0 118214 17 0 0 25 0 1 0 521235171 36474880 8106 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328366 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 8905 8106 127 39 0 7985 0
[pid=2099] ppid=2089 vsize=36528 CPUtime=588.41 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 14236 0 0 0 58839 2 0 0 25 0 1 0 521235171 37404672 6171 33554432000 4194304 4331988 140735771417168 18446744073709551615 4265456 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 9132 6171 175 34 0 7574 0
Current children cumulated CPU time (s) 3544.49
Current children cumulated vsize (KiB) 598048

[startup+1242.3 s]
/proc/loadavg: 8.21 8.12 7.38 9/186 2211
/proc/meminfo: memFree=30889720/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=54136 CPUtime=1242.31 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 10412 0 0 0 124229 2 0 0 25 0 1 0 521235171 55435264 10204 33554432000 4194304 4785740 140733673669168 18446744073709551615 222921474643 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 13534 10204 340 145 0 10579 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=617.31 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 61731 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134530144 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=41636 CPUtime=1242.32 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 129388 0 0 0 124214 18 0 0 25 0 1 0 521235171 42635264 9610 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328375 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 10409 9610 127 39 0 9489 0
[pid=2099] ppid=2089 vsize=36528 CPUtime=618.2 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 14325 0 0 0 61818 2 0 0 25 0 1 0 521235171 37404672 6260 33554432000 4194304 4331988 140735771417168 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 9132 6260 175 34 0 7574 0
Current children cumulated CPU time (s) 3724.18
Current children cumulated vsize (KiB) 605532



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 8.17 8.12 7.42 10/186 2212
/proc/meminfo: memFree=30888056/32951124 swapFree=67110188/67111528
[pid=2089] ppid=2085 vsize=18324 CPUtime=4.04 cores=1,3,5,7
/proc/2089/stat : 2089 (ppfolio) S 2085 2089 2052 0 -1 4202496 518 6676 2 0 0 0 403 1 15 0 1 0 521235170 18763776 390 33554432000 4194304 4287625 140733608406192 18446744073709551615 222921797135 0 0 4096 65536 4294934790 0 0 17 5 0 0 0
/proc/2089/statm: 4581 390 342 23 0 91 0
[pid=2094] ppid=2089 vsize=54460 CPUtime=1300.02 cores=5
/proc/2094/stat : 2094 (clasp) R 2089 2089 2052 0 -1 4202496 10528 0 0 0 129999 3 0 0 25 0 1 0 521235171 55767040 10320 33554432000 4194304 4785740 140733673669168 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2094/statm: 13615 10320 340 145 0 10660 0
[pid=2095] ppid=2089 vsize=454908 CPUtime=646 cores=7
/proc/2095/stat : 2095 (TNM) R 2089 2089 2052 0 -1 4202496 1278 0 0 0 64600 0 0 0 25 0 1 0 521235171 465825792 1175 33554432000 134512640 134534564 4290909232 18446744073709551615 134530339 0 0 4096 0 0 0 0 17 7 0 0 90
/proc/2095/statm: 113727 1175 95 6 0 112393 0
[pid=2097] ppid=2089 vsize=37668 CPUtime=1300.02 cores=3
/proc/2097/stat : 2097 (lingeling) R 2089 2089 2052 0 -1 4202496 132444 0 0 0 129984 18 0 0 25 0 1 0 521235171 38572032 8618 33554432000 4194304 4352236 140734142639824 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2097/statm: 9417 8618 127 39 0 8497 0
[pid=2099] ppid=2089 vsize=36528 CPUtime=646.9 cores=7
/proc/2099/stat : 2099 (march_hi) R 2089 2089 2052 0 -1 4202496 14449 0 0 0 64688 2 0 0 25 0 1 0 521235171 37404672 6384 33554432000 4194304 4331988 140735771417168 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2099/statm: 9132 6384 175 34 0 7574 0
Current children cumulated CPU time (s) 3896.98
Current children cumulated vsize (KiB) 601888

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2089 and gives
#  childrusage.ru_utime.tv_sec=1950
#  childrusage.ru_utime.tv_usec=41548
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=50992
# CPU time returned by wait4() is 1950.09
# while last known CPU time is 3896.98
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 3896.98
CPU user time (s): 3896.74
CPU system time (s): 0.24
CPU usage (%): 299.766
Max. virtual memory (cumulated for all children) (KiB): 1737884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1950.04
system time used= 0.050992
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19034
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 199
involuntary context switches= 17704

runsolver used 2.00769 second user time and 5.09023 second system time

The end

Launcher Data 

Begin job on node109 at 2011-04-29 18:59:04
IDJOB=3265649
IDBENCH=85793
IDSOLVER=1612
FILE ID=node109/3265649-1304096344
RUNJOBID= node109-1304096344-2071
PBS_JOBID= 13170607
Free space on /tmp= 72384 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT05/crafted/sorge05/QG7a/gensys-ukn009.shuffled-as.sat05-3849.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265649-1304096344/watcher-3265649-1304096344 -o /tmp/evaluation-result-3265649-1304096344/solver-3265649-1304096344 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3265649-1304096344.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f2a1eb7937a7cda114ce344a30ca1145
RANDOM SEED=1276971172

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31043532 kB
Buffers:        722196 kB
Cached:         731900 kB
SwapCached:        712 kB
Active:         140104 kB
Inactive:      1377304 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31043532 kB
SwapTotal:    67111528 kB
SwapFree:     67110188 kB
Dirty:           21448 kB
Writeback:           8 kB
AnonPages:       62792 kB
Mapped:          14336 kB
Slab:           325580 kB
PageTables:       4500 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186680 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72364 MiB
End job on node109 at 2011-04-29 19:20:44