Trace number 3191278

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.32 1201.71

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v650-c2769-S216164582-083.UNKNOWN.cnf
MD5SUMac87980bdfffc015f316143175a762b6
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables650
Number of clauses2769
Sum of the clauses size8307
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32769
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191278-1304076890/watcher-3191278-1304076890 -o /tmp/evaluation-result-3191278-1304076890/solver-3191278-1304076890 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191278-1304076890.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.65 7.07 7.17 5/181 31971
/proc/meminfo: memFree=31442072/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 16 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0

[startup+1.23327 s]
/proc/loadavg: 6.65 7.07 7.17 5/181 31971
/proc/meminfo: memFree=31442072/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.34148 s]
/proc/loadavg: 6.65 7.07 7.17 5/181 31971
/proc/meminfo: memFree=31442072/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.46846 s]
/proc/loadavg: 6.65 7.07 7.17 5/181 31971
/proc/meminfo: memFree=31442072/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50046 s]
/proc/loadavg: 6.65 7.07 7.17 5/181 31971
/proc/meminfo: memFree=31442072/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.64643 s]
/proc/loadavg: 6.65 7.07 7.17 5/181 31971
/proc/meminfo: memFree=31442072/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10118 s]
/proc/loadavg: 6.84 7.10 7.18 10/187 31977
/proc/meminfo: memFree=31423052/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1694168 CPUtime=3.09 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 4851 0 0 0 309 0 0 0 25 0 1 0 519287811 1734828032 2610 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238736 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 423542 2610 337 96 0 420104 0
[pid=31973] ppid=31971 vsize=15112 CPUtime=3.09 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 1243 0 0 0 309 0 0 0 25 0 1 0 519287811 15474688 1130 33554432000 4194304 4785740 140736700150480 18446744073709551615 4549576 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 3778 1130 340 145 0 823 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=2.17 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 217 0 0 0 21 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134530158 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=6632 CPUtime=3.09 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 1183 0 0 0 309 0 0 0 25 0 1 0 519287811 6791168 855 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328423 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 1658 855 126 39 0 738 0
[pid=31976] ppid=31971 vsize=8360 CPUtime=0.91 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 668 0 0 0 91 0 0 0 25 0 1 0 519287811 8560640 561 33554432000 4194304 4331988 140734247184752 18446744073709551615 4226341 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 2090 561 172 34 0 532 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 2198552

[startup+6.30061 s]
/proc/loadavg: 6.84 7.10 7.18 10/187 31978
/proc/meminfo: memFree=31418756/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1695140 CPUtime=6.29 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 7210 0 0 0 629 0 0 0 25 0 1 0 519287811 1735823360 2617 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238294 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 423785 2617 337 96 0 420347 0
[pid=31973] ppid=31971 vsize=16208 CPUtime=6.29 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 1514 0 0 0 629 0 0 0 25 0 1 0 519287811 16596992 1401 33554432000 4194304 4785740 140736700150480 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 4052 1401 340 145 0 1097 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=3.75 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 375 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=6892 CPUtime=6.29 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 1729 0 0 0 629 0 0 0 25 0 1 0 519287811 7057408 921 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 1723 921 126 39 0 803 0
[pid=31976] ppid=31971 vsize=8816 CPUtime=2.51 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 786 0 0 0 251 0 0 0 25 0 1 0 519287811 9027584 679 33554432000 4194304 4331988 140734247184752 18446744073709551615 4227058 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 2204 679 173 34 0 646 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 2201336

[startup+12.7005 s]
/proc/loadavg: 7.25 7.18 7.20 10/187 31978
/proc/meminfo: memFree=31410108/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1704780 CPUtime=12.69 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 11508 0 0 0 1268 1 0 0 25 0 1 0 519287811 1745694720 3612 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238240 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 426195 3612 337 96 0 422757 0
[pid=31973] ppid=31971 vsize=17728 CPUtime=12.69 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 1867 0 0 0 1269 0 0 0 25 0 1 0 519287811 18153472 1754 33554432000 4194304 4785740 140736700150480 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 4432 1754 340 145 0 1477 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=6.94 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 694 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134529024 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=8436 CPUtime=12.69 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 2947 0 0 0 1269 0 0 0 25 0 1 0 519287811 8638464 1307 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 2109 1307 126 39 0 1189 0
[pid=31976] ppid=31971 vsize=9384 CPUtime=5.68 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 914 0 0 0 568 0 0 0 25 0 1 0 519287811 9609216 807 33554432000 4194304 4331988 140734247184752 18446744073709551615 4240760 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 2346 807 173 34 0 788 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 2214608

[startup+25.5012 s]
/proc/loadavg: 7.60 7.26 7.22 10/187 31978
/proc/meminfo: memFree=31398692/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1707924 CPUtime=25.49 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 17514 0 0 0 2546 3 0 0 25 0 1 0 519287811 1748914176 4171 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 426981 4171 337 96 0 423543 0
[pid=31973] ppid=31971 vsize=19796 CPUtime=25.49 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 2369 0 0 0 2549 0 0 0 25 0 1 0 519287811 20271104 2256 33554432000 4194304 4785740 140736700150480 18446744073709551615 4549064 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 4949 2256 340 145 0 1994 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=13.34 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 1334 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=9304 CPUtime=25.48 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 5126 0 0 0 2548 0 0 0 25 0 1 0 519287811 9527296 1525 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328304 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 2326 1525 127 39 0 1406 0
[pid=31976] ppid=31971 vsize=10760 CPUtime=12.01 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 1198 0 0 0 1201 0 0 0 25 0 1 0 519287811 11018240 1049 33554432000 4194304 4331988 140734247184752 18446744073709551615 4212341 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 2690 1049 173 34 0 1132 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 2222064

[startup+51.1007 s]
/proc/loadavg: 8.13 7.41 7.28 10/187 31979
/proc/meminfo: memFree=31376676/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1712136 CPUtime=51.09 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 28808 0 0 0 5104 5 0 0 25 0 1 0 519287811 1753227264 7515 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238509 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 428034 7515 337 96 0 424596 0
[pid=31973] ppid=31971 vsize=22752 CPUtime=51.09 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 3096 0 0 0 5109 0 0 0 25 0 1 0 519287811 23298048 2983 33554432000 4194304 4785740 140736700150480 18446744073709551615 4561965 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 5688 2983 340 145 0 2733 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=26.04 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 2604 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=12376 CPUtime=51.09 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 9510 0 0 0 5108 1 0 0 25 0 1 0 519287811 12673024 2293 33554432000 4194304 4352236 140735946020176 18446744073709551615 4327936 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 3094 2293 127 39 0 2174 0
[pid=31976] ppid=31971 vsize=12776 CPUtime=24.77 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 1671 0 0 0 2477 0 0 0 25 0 1 0 519287811 13082624 1522 33554432000 4194304 4331988 140734247184752 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 3194 1522 173 34 0 1636 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 2234320

[startup+102.301 s]
/proc/loadavg: 8.75 7.71 7.38 10/187 31980
/proc/meminfo: memFree=31339504/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1734864 CPUtime=102.29 cores=0

################
# More data... #
################

/proc/31976/statm: 21455 16444 173 34 0 19897 0
Current children cumulated CPU time (s) 3764.1
Current children cumulated vsize (KiB) 2430516

[startup+1002.3 s]
/proc/loadavg: 9.18 9.10 8.47 10/187 32004
/proc/meminfo: memFree=31063852/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1793472 CPUtime=1002.31 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 97145 0 0 0 100205 26 0 0 25 0 1 0 519287811 1836515328 27684 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 448368 27684 337 96 0 444930 0
[pid=31973] ppid=31971 vsize=46176 CPUtime=1002.31 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 8477 0 0 0 100229 2 0 0 25 0 1 0 519287811 47284224 8364 33554432000 4194304 4785740 140736700150480 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 11544 8364 340 145 0 8589 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=499.07 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 49907 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=36576 CPUtime=1002.3 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 85768 0 0 0 100218 12 0 0 25 0 1 0 519287811 37453824 8343 33554432000 4194304 4352236 140735946020176 18446744073709551615 4329032 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 9144 8343 127 39 0 8224 0
[pid=31976] ppid=31971 vsize=85820 CPUtime=497.78 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 17477 0 0 0 49766 12 0 0 25 0 1 0 519287811 87879680 17328 33554432000 4194304 4331988 140734247184752 18446744073709551615 4226560 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 21455 17328 173 34 0 19897 0
Current children cumulated CPU time (s) 4003.77
Current children cumulated vsize (KiB) 2436324

[startup+1062.3 s]
/proc/loadavg: 9.25 9.14 8.52 10/187 32006
/proc/meminfo: memFree=31063292/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1793596 CPUtime=1062.31 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 101714 0 0 0 106203 28 0 0 25 0 1 0 519287811 1836642304 27726 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 448399 27726 337 96 0 444961 0
[pid=31973] ppid=31971 vsize=47020 CPUtime=1062.31 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 8654 0 0 0 106229 2 0 0 25 0 1 0 519287811 48148480 8541 33554432000 4194304 4785740 140736700150480 18446744073709551615 4287147 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 11755 8541 340 145 0 8800 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=528.9 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 52890 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=25824 CPUtime=1062.31 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 87816 0 0 0 106218 13 0 0 25 0 1 0 519287811 26443776 5655 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 6456 5655 127 39 0 5536 0
[pid=31976] ppid=31971 vsize=85820 CPUtime=527.62 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 18395 0 0 0 52750 12 0 0 25 0 1 0 519287811 87879680 18246 33554432000 4194304 4331988 140734247184752 18446744073709551615 4211480 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 21455 18246 173 34 0 19897 0
Current children cumulated CPU time (s) 4243.45
Current children cumulated vsize (KiB) 2426540

[startup+1122.3 s]
/proc/loadavg: 9.17 9.14 8.56 10/187 32007
/proc/meminfo: memFree=31052816/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1793696 CPUtime=1122.31 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 105771 0 0 0 112202 29 0 0 25 0 1 0 519287811 1836744704 27198 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238477 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 448424 27198 337 96 0 444986 0
[pid=31973] ppid=31971 vsize=47336 CPUtime=1122.31 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 8740 0 0 0 112229 2 0 0 25 0 1 0 519287811 48472064 8627 33554432000 4194304 4785740 140736700150480 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 11834 8627 340 145 0 8879 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=558.76 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 55876 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134528628 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=31200 CPUtime=1122.31 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 91848 0 0 0 112217 14 0 0 25 0 1 0 519287811 31948800 6999 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 7800 6999 127 39 0 6880 0
[pid=31976] ppid=31971 vsize=115288 CPUtime=557.44 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 19391 0 0 0 55731 13 0 0 25 0 1 0 519287811 118054912 19242 33554432000 4194304 4331988 140734247184752 18446744073709551615 4211525 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 28822 19242 173 34 0 27264 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 2461800

[startup+1182.3 s]
/proc/loadavg: 9.18 9.16 8.60 10/187 32009
/proc/meminfo: memFree=31052132/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1793028 CPUtime=1182.31 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 109694 0 0 0 118200 31 0 0 25 0 1 0 519287811 1836060672 26333 33554432000 4194304 4587354 140734951820832 18446744073709551615 235594563266 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 448257 26333 337 96 0 444819 0
[pid=31973] ppid=31971 vsize=48376 CPUtime=1182.31 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 8954 0 0 0 118229 2 0 0 25 0 1 0 519287811 49537024 8841 33554432000 4194304 4785740 140736700150480 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 12094 8841 340 145 0 9139 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=588.56 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 58856 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134528710 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=24800 CPUtime=1182.31 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 93640 0 0 0 118217 14 0 0 25 0 1 0 519287811 25395200 5399 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 6200 5399 127 39 0 5280 0
[pid=31976] ppid=31971 vsize=115288 CPUtime=587.31 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 20386 0 0 0 58718 13 0 0 25 0 1 0 519287811 118054912 20237 33554432000 4194304 4331988 140734247184752 18446744073709551615 4211503 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 28822 20237 173 34 0 27264 0
Current children cumulated CPU time (s) 4722.8
Current children cumulated vsize (KiB) 2455772



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 9.27 9.18 8.62 11/187 32009
/proc/meminfo: memFree=31032124/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1793028 CPUtime=1201.72 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 111765 0 0 0 120139 33 0 0 25 0 1 0 519287811 1836060672 28343 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 448257 28343 337 96 0 444819 0
[pid=31973] ppid=31971 vsize=48508 CPUtime=1201.72 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 8989 0 0 0 120170 2 0 0 25 0 1 0 519287811 49672192 8876 33554432000 4194304 4785740 140736700150480 18446744073709551615 4553784 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 12127 8876 340 145 0 9172 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=598.25 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 59825 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=36576 CPUtime=1201.72 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 96584 0 0 0 120158 14 0 0 25 0 1 0 519287811 37453824 8343 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328068 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 9144 8343 127 39 0 8224 0
[pid=31976] ppid=31971 vsize=115288 CPUtime=596.91 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 20695 0 0 0 59678 13 0 0 25 0 1 0 519287811 118054912 20546 33554432000 4194304 4331988 140734247184752 18446744073709551615 4315805 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 28822 20546 173 34 0 27264 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 2467680

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 9.27 9.18 8.62 11/187 32009
/proc/meminfo: memFree=31032124/32950928 swapFree=67111404/67111528
[pid=31971] ppid=31969 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31971/stat : 31971 (ppfolio) S 31969 31971 30873 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519287811 18763776 390 33554432000 4194304 4287625 140736589939104 18446744073709551615 235594886671 0 0 4096 65536 12495360865492533247 0 0 17 4 0 0 0
/proc/31971/statm: 4581 390 341 23 0 91 0
[pid=31972] ppid=31971 vsize=1793028 CPUtime=1201.72 cores=0
/proc/31972/stat : 31972 (cryptominisat) R 31971 31971 30873 0 -1 4202496 111765 0 0 0 120139 33 0 0 25 0 1 0 519287811 1836060672 28343 33554432000 4194304 4587354 140734951820832 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31972/statm: 448257 28343 337 96 0 444819 0
[pid=31973] ppid=31971 vsize=48508 CPUtime=1201.72 cores=4
/proc/31973/stat : 31973 (clasp) R 31971 31971 30873 0 -1 4202496 8989 0 0 0 120170 2 0 0 25 0 1 0 519287811 49672192 8876 33554432000 4194304 4785740 140736700150480 18446744073709551615 4553784 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31973/statm: 12127 8876 340 145 0 9172 0
[pid=31974] ppid=31971 vsize=455956 CPUtime=598.25 cores=6
/proc/31974/stat : 31974 (TNM) R 31971 31971 30873 0 -1 4202496 364 0 0 0 59825 0 0 0 25 0 1 0 519287811 466898944 261 33554432000 134512640 134534564 4287197856 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31974/statm: 113989 261 95 6 0 112655 0
[pid=31975] ppid=31971 vsize=36576 CPUtime=1201.72 cores=2
/proc/31975/stat : 31975 (lingeling) R 31971 31971 30873 0 -1 4202496 96584 0 0 0 120158 14 0 0 25 0 1 0 519287811 37453824 8343 33554432000 4194304 4352236 140735946020176 18446744073709551615 4328068 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31975/statm: 9144 8343 127 39 0 8224 0
[pid=31976] ppid=31971 vsize=115288 CPUtime=596.91 cores=6
/proc/31976/stat : 31976 (march_hi) R 31971 31971 30873 0 -1 4202496 20695 0 0 0 59678 13 0 0 25 0 1 0 519287811 118054912 20546 33554432000 4194304 4331988 140734247184752 18446744073709551615 4315805 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31976/statm: 28822 20546 173 34 0 27264 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 2467680

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31971 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=2999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 4800.32
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.32
CPU user time (s): 4799.7
CPU system time (s): 0.62
CPU usage (%): 399.456
Max. virtual memory (cumulated for all children) (KiB): 4096544

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.002999
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 523
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 438
involuntary context switches= 6

runsolver used 1.85372 second user time and 4.70528 second system time

The end

Launcher Data 

Begin job on node120 at 2011-04-29 13:34:50
IDJOB=3191278
IDBENCH=83009
IDSOLVER=1612
FILE ID=node120/3191278-1304076890
RUNJOBID= node120-1304076866-31754
PBS_JOBID= 13170475
Free space on /tmp= 72064 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v650-c2769-S216164582-083.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191278-1304076890/watcher-3191278-1304076890 -o /tmp/evaluation-result-3191278-1304076890/solver-3191278-1304076890 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191278-1304076890.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac87980bdfffc015f316143175a762b6
RANDOM SEED=241329732

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31442228 kB
Buffers:        456648 kB
Cached:         609552 kB
SwapCached:          8 kB
Active:         430620 kB
Inactive:       718388 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31442228 kB
SwapTotal:    67111528 kB
SwapFree:     67111404 kB
Dirty:           20404 kB
Writeback:           0 kB
AnonPages:       82796 kB
Mapped:          16500 kB
Slab:           296316 kB
PageTables:       4724 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   684344 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72056 MiB
End job on node120 at 2011-04-29 13:54:54