Trace number 3191273

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 3897.27 1300.01

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S1836400953-011.UNKNOWN.cnf
MD5SUM39542bd0a185b4f7c5fc7900079a2845
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.00/0.10	This is pico-portfolio, a naive parallel portfolio
0.00/0.10	Copyright (C) 2011 Olivier Roussel
0.00/0.10	Using 4 processing units
0.00/0.10	This portfolio uses the following solvers:
0.00/0.10	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.10	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.10	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.10	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.10	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.10	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.10	Starting clasp 1.3.6 on core(s) 5
0.00/0.10	Starting TNM 2009 on core(s) 7
0.00/0.10	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.10	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191273-1304076867/watcher-3191273-1304076867 -o /tmp/evaluation-result-3191273-1304076867/solver-3191273-1304076867 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191273-1304076867.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.91 6.81 7.08 11/182 31811
/proc/meminfo: memFree=31455320/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) R 31809 31811 30873 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 519285437 18763776 390 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/31811/statm: 4581 390 341 23 0 91 0

[startup+0.11977 s]
/proc/loadavg: 4.91 6.81 7.08 11/182 31811
/proc/meminfo: memFree=31455320/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 519285437 18763776 390 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 4241554812124004351 0 0 17 5 0 0 0
/proc/31811/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.201546 s]
/proc/loadavg: 4.91 6.81 7.08 11/182 31811
/proc/meminfo: memFree=31455320/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) R 31809 31811 30873 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 519285437 18763776 390 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/31811/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300529 s]
/proc/loadavg: 4.91 6.81 7.08 11/182 31811
/proc/meminfo: memFree=31455320/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) R 31809 31811 30873 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 519285437 18763776 390 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/31811/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700459 s]
/proc/loadavg: 4.91 6.81 7.08 11/182 31811
/proc/meminfo: memFree=31455320/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 519285437 18763776 390 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 4241554812124004351 0 0 17 5 0 0 0
/proc/31811/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50032 s]
/proc/loadavg: 5.72 6.94 7.13 11/188 31817
/proc/meminfo: memFree=31434592/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519285437 18763776 390 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 4241554812124004351 0 0 17 5 0 0 0
/proc/31811/statm: 4581 390 341 23 0 91 0
[pid=31812] ppid=31811 vsize=1595748 CPUtime=1.48 cores=1
/proc/31812/stat : 31812 (cryptominisat) R 31811 31811 30873 0 -1 4202496 4412 0 0 0 148 0 0 0 25 0 1 0 519285438 1634045952 2896 33554432000 4194304 4587354 140735063071920 18446744073709551615 4238600 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31812/statm: 398937 2896 337 96 0 395499 0
[pid=31813] ppid=31811 vsize=14336 CPUtime=1.49 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 1050 0 0 0 149 0 0 0 25 0 1 0 519285438 14680064 941 33554432000 4194304 4785740 140736437277088 18446744073709551615 4287104 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 3584 941 340 145 0 629 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=0.64 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 64 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134529080 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=6184 CPUtime=1.49 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 1142 0 0 0 149 0 0 0 25 0 1 0 519285438 6332416 740 33554432000 4194304 4352236 140736127246544 18446744073709551615 4329066 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 1546 740 127 39 0 626 0
[pid=31816] ppid=31811 vsize=7732 CPUtime=0.83 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 559 0 0 0 83 0 0 0 25 0 1 0 519285438 7917568 444 33554432000 4194304 4331988 140737357025344 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 1933 444 175 34 0 375 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 2098412

[startup+3.10104 s]
/proc/loadavg: 5.72 6.94 7.13 11/188 31817
/proc/meminfo: memFree=31422192/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519285437 18763776 390 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 4241554812124004351 0 0 17 5 0 0 0
/proc/31811/statm: 4581 390 341 23 0 91 0
[pid=31812] ppid=31811 vsize=1597812 CPUtime=3.08 cores=1
/proc/31812/stat : 31812 (cryptominisat) R 31811 31811 30873 0 -1 4202496 6153 0 0 0 308 0 0 0 25 0 1 0 519285438 1636159488 3559 33554432000 4194304 4587354 140735063071920 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31812/statm: 399453 3559 337 96 0 396015 0
[pid=31813] ppid=31811 vsize=15044 CPUtime=3.09 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 1231 0 0 0 309 0 0 0 25 0 1 0 519285438 15405056 1122 33554432000 4194304 4785740 140736437277088 18446744073709551615 4278070 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 3761 1122 341 145 0 806 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=1.44 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 144 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=6636 CPUtime=3.09 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 1351 0 0 0 309 0 0 0 25 0 1 0 519285438 6795264 821 33554432000 4194304 4352236 140736127246544 18446744073709551615 4328162 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 1659 821 127 39 0 739 0
[pid=31816] ppid=31811 vsize=7884 CPUtime=1.63 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 608 0 0 0 163 0 0 0 25 0 1 0 519285438 8073216 493 33554432000 4194304 4331988 140737357025344 18446744073709551615 4210548 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 1971 493 175 34 0 413 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 2101788

[startup+6.30047 s]
/proc/loadavg: 5.98 6.97 7.14 11/187 31881
/proc/meminfo: memFree=31432204/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=16032 CPUtime=6.29 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 1444 0 0 0 629 0 0 0 25 0 1 0 519285438 16416768 1335 33554432000 4194304 4785740 140736437277088 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 4008 1335 341 145 0 1053 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=3.04 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 304 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=7920 CPUtime=6.29 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 2040 0 0 0 629 0 0 0 25 0 1 0 519285438 8110080 1158 33554432000 4194304 4352236 140736127246544 18446744073709551615 4329024 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 1980 1158 127 39 0 1060 0
[pid=31816] ppid=31811 vsize=8452 CPUtime=3.21 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 702 0 0 0 321 0 0 0 25 0 1 0 519285438 8654848 587 33554432000 4194304 4331988 140737357025344 18446744073709551615 4265323 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 2113 587 175 34 0 555 0
Current children cumulated CPU time (s) 23.16
Current children cumulated vsize (KiB) 506816

[startup+12.7003 s]
/proc/loadavg: 6.22 7.01 7.15 10/187 31913
/proc/meminfo: memFree=31421068/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=17300 CPUtime=12.69 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 1761 0 0 0 1269 0 0 0 25 0 1 0 519285438 17715200 1652 33554432000 4194304 4785740 140736437277088 18446744073709551615 4278129 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 4325 1652 341 145 0 1370 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=6.21 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 621 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134530669 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=8308 CPUtime=12.69 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 2649 0 0 0 1269 0 0 0 25 0 1 0 519285438 8507392 1255 33554432000 4194304 4352236 140736127246544 18446744073709551615 4328351 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 2077 1255 127 39 0 1157 0
[pid=31816] ppid=31811 vsize=9728 CPUtime=6.41 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 892 0 0 0 641 0 0 0 25 0 1 0 519285438 9961472 777 33554432000 4194304 4331988 140737357025344 18446744073709551615 4237136 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 2432 777 175 34 0 874 0
Current children cumulated CPU time (s) 42.33
Current children cumulated vsize (KiB) 509748

[startup+25.5011 s]
/proc/loadavg: 6.84 7.10 7.18 10/187 31977
/proc/meminfo: memFree=31423176/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=19024 CPUtime=25.49 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 2159 0 0 0 2549 0 0 0 25 0 1 0 519285438 19480576 2050 33554432000 4194304 4785740 140736437277088 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 4756 2050 341 145 0 1801 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=12.54 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 1254 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134530619 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=11764 CPUtime=25.49 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 4489 0 0 0 2549 0 0 0 25 0 1 0 519285438 12046336 2135 33554432000 4194304 4352236 140736127246544 18446744073709551615 4328191 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 2941 2135 127 39 0 2021 0
[pid=31816] ppid=31811 vsize=10880 CPUtime=12.8 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 1231 0 0 0 1280 0 0 0 25 0 1 0 519285438 11141120 1116 33554432000 4194304 4331988 140737357025344 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 2720 1116 175 34 0 1162 0
Current children cumulated CPU time (s) 80.65
Current children cumulated vsize (KiB) 516080

[startup+51.1006 s]
/proc/loadavg: 7.79 7.30 7.24 10/187 31978
/proc/meminfo: memFree=31397204/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=21544 CPUtime=51.09 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 2696 0 0 0 5109 0 0 0 25 0 1 0 519285438 22061056 2587 33554432000 4194304 4785740 140736437277088 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 5386 2587 341 145 0 2431 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=25.31 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 2531 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134530635 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=11580 CPUtime=51.09 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 6538 0 0 0 5108 1 0 0 25 0 1 0 519285438 11857920 2089 33554432000 4194304 4352236 140736127246544 18446744073709551615 4276488 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 2895 2089 127 39 0 1975 0
[pid=31816] ppid=31811 vsize=15440 CPUtime=25.5 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 1974 0 0 0 2550 0 0 0 25 0 1 0 519285438 15810560 1859 33554432000 4194304 4331988 140737357025344 18446744073709551615 4239578 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 3860 1859 175 34 0 2302 0
Current children cumulated CPU time (s) 157.32
Current children cumulated vsize (KiB) 522976

[startup+102.301 s]
/proc/loadavg: 8.54 7.58 7.33 10/187 31979
/proc/meminfo: memFree=31366796/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7

################
# More data... #
################


[startup+1002.3 s]
/proc/loadavg: 9.27 9.11 8.46 10/187 32003
/proc/meminfo: memFree=31089160/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=37260 CPUtime=1002.31 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 6358 0 0 0 100230 1 0 0 25 0 1 0 519285438 38154240 6249 33554432000 4194304 4785740 140736437277088 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 9315 6249 341 145 0 6360 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=498.29 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 49829 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134528483 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=32864 CPUtime=1002.31 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 72876 0 0 0 100221 10 0 0 25 0 1 0 519285438 33652736 7410 33554432000 4194304 4352236 140736127246544 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 8216 7410 127 39 0 7296 0
[pid=31816] ppid=31811 vsize=144004 CPUtime=498.52 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 24507 0 0 0 49846 6 0 0 25 0 1 0 519285438 147460096 24392 33554432000 4194304 4331988 140737357025344 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 36001 24392 175 34 0 34443 0
Current children cumulated CPU time (s) 3005.76
Current children cumulated vsize (KiB) 688540

[startup+1062.3 s]
/proc/loadavg: 9.38 9.16 8.51 10/187 32005
/proc/meminfo: memFree=31076700/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=37808 CPUtime=1062.31 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 6506 0 0 0 106230 1 0 0 25 0 1 0 519285438 38715392 6397 33554432000 4194304 4785740 140736437277088 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 9452 6397 341 145 0 6497 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=528.16 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 52816 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134530512 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=22752 CPUtime=1062.31 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 75148 0 0 0 106221 10 0 0 25 0 1 0 519285438 23298048 4882 33554432000 4194304 4352236 140736127246544 18446744073709551615 4329000 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 5688 4882 127 39 0 4768 0
[pid=31816] ppid=31811 vsize=144004 CPUtime=528.32 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 25687 0 0 0 52825 7 0 0 25 0 1 0 519285438 147460096 25572 33554432000 4194304 4331988 140737357025344 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 36001 25572 175 34 0 34443 0
Current children cumulated CPU time (s) 3185.43
Current children cumulated vsize (KiB) 678976

[startup+1122.3 s]
/proc/loadavg: 9.26 9.16 8.55 10/187 32007
/proc/meminfo: memFree=31068584/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=38396 CPUtime=1122.31 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 6611 0 0 0 112230 1 0 0 25 0 1 0 519285438 39317504 6502 33554432000 4194304 4785740 140736437277088 18446744073709551615 4287229 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 9599 6502 341 145 0 6644 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=557.96 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 55796 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134528918 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=22752 CPUtime=1122.31 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 78572 0 0 0 112221 10 0 0 25 0 1 0 519285438 23298048 4882 33554432000 4194304 4352236 140736127246544 18446744073709551615 4328032 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 5688 4882 127 39 0 4768 0
[pid=31816] ppid=31811 vsize=147972 CPUtime=558.2 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 27224 0 0 0 55812 8 0 0 25 0 1 0 519285438 151523328 27109 33554432000 4194304 4331988 140737357025344 18446744073709551615 4228313 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 36993 27109 175 34 0 35435 0
Current children cumulated CPU time (s) 3365.11
Current children cumulated vsize (KiB) 683532

[startup+1182.3 s]
/proc/loadavg: 9.28 9.17 8.59 10/187 32008
/proc/meminfo: memFree=31043960/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=38648 CPUtime=1182.31 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 6665 0 0 0 118230 1 0 0 25 0 1 0 519285438 39575552 6556 33554432000 4194304 4785740 140736437277088 18446744073709551615 4287248 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 9662 6556 341 145 0 6707 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=587.82 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 58782 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=34656 CPUtime=1182.32 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 82924 0 0 0 118221 11 0 0 25 0 1 0 519285438 35487744 7858 33554432000 4194304 4352236 140736127246544 18446744073709551615 4329205 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 8664 7858 127 39 0 7744 0
[pid=31816] ppid=31811 vsize=147972 CPUtime=588.01 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 28634 0 0 0 58793 8 0 0 25 0 1 0 519285438 151523328 28519 33554432000 4194304 4331988 140737357025344 18446744073709551615 4299339 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 36993 28519 175 34 0 35435 0
Current children cumulated CPU time (s) 3544.79
Current children cumulated vsize (KiB) 695688

[startup+1242.3 s]
/proc/loadavg: 9.21 9.17 8.62 10/187 32075
/proc/meminfo: memFree=31252912/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=38904 CPUtime=1242.31 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 6744 0 0 0 124230 1 0 0 25 0 1 0 519285438 39837696 6635 33554432000 4194304 4785740 140736437277088 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 9726 6635 341 145 0 6771 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=617.65 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 61765 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134528473 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=31200 CPUtime=1242.32 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 86860 0 0 0 124221 11 0 0 25 0 1 0 519285438 31948800 6994 33554432000 4194304 4352236 140736127246544 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 7800 6994 127 39 0 6880 0
[pid=31816] ppid=31811 vsize=147972 CPUtime=617.86 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 30129 0 0 0 61777 9 0 0 25 0 1 0 519285438 151523328 30014 33554432000 4194304 4331988 140737357025344 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 36993 30014 175 34 0 35435 0
Current children cumulated CPU time (s) 3724.47
Current children cumulated vsize (KiB) 692488



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.44 9.23 8.68 13/186 32171
/proc/meminfo: memFree=31274032/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=39156 CPUtime=1300.02 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 6776 0 0 0 130001 1 0 0 25 0 1 0 519285438 40095744 6667 33554432000 4194304 4785740 140736437277088 18446744073709551615 4553366 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 9789 6667 341 145 0 6834 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=646.35 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 64635 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=31200 CPUtime=1300.02 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 88236 0 0 0 129991 11 0 0 25 0 1 0 519285438 31948800 6994 33554432000 4194304 4352236 140736127246544 18446744073709551615 4328114 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 7800 6994 127 39 0 6880 0
[pid=31816] ppid=31811 vsize=147972 CPUtime=646.55 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 31497 0 0 0 64645 10 0 0 25 0 1 0 519285438 151523328 31382 33554432000 4194304 4331988 140737357025344 18446744073709551615 4226198 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 36993 31382 175 34 0 35435 0
Current children cumulated CPU time (s) 3897.27
Current children cumulated vsize (KiB) 692740

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 9.44 9.23 8.68 13/186 32171
/proc/meminfo: memFree=31274032/32950928 swapFree=67111404/67111528
[pid=31811] ppid=31809 vsize=18324 CPUtime=4.33 cores=1,3,5,7
/proc/31811/stat : 31811 (ppfolio) S 31809 31811 30873 0 -1 4202496 526 7177 0 0 0 0 432 1 15 0 1 0 519285437 18763776 391 33554432000 4194304 4287625 140734429587456 18446744073709551615 235594886671 0 0 4096 65536 9224195742862639367 0 0 17 5 0 0 0
/proc/31811/statm: 4581 391 342 23 0 91 0
[pid=31813] ppid=31811 vsize=39156 CPUtime=1300.02 cores=5
/proc/31813/stat : 31813 (clasp) R 31811 31811 30873 0 -1 4202496 6776 0 0 0 130001 1 0 0 25 0 1 0 519285438 40095744 6667 33554432000 4194304 4785740 140736437277088 18446744073709551615 4553366 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31813/statm: 9789 6667 341 145 0 6834 0
[pid=31814] ppid=31811 vsize=456088 CPUtime=646.35 cores=7
/proc/31814/stat : 31814 (TNM) R 31811 31811 30873 0 -1 4202496 378 0 10 0 64635 0 0 0 25 0 1 0 519285438 467034112 285 33554432000 134512640 134534564 4290481536 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 7 0 0 13
/proc/31814/statm: 114022 285 95 6 0 112688 0
[pid=31815] ppid=31811 vsize=31200 CPUtime=1300.02 cores=3
/proc/31815/stat : 31815 (lingeling) R 31811 31811 30873 0 -1 4202496 88236 0 0 0 129991 11 0 0 25 0 1 0 519285438 31948800 6994 33554432000 4194304 4352236 140736127246544 18446744073709551615 4328114 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31815/statm: 7800 6994 127 39 0 6880 0
[pid=31816] ppid=31811 vsize=147972 CPUtime=646.55 cores=7
/proc/31816/stat : 31816 (march_hi) R 31811 31811 30873 0 -1 4202496 31497 0 0 0 64645 10 0 0 25 0 1 0 519285438 151523328 31382 33554432000 4194304 4331988 140737357025344 18446744073709551615 4226198 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31816/statm: 36993 31382 175 34 0 35435 0
Current children cumulated CPU time (s) 3897.27
Current children cumulated vsize (KiB) 692740

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31811 and gives
#  childrusage.ru_utime.tv_sec=2604
#  childrusage.ru_utime.tv_usec=256092
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=147977
# CPU time returned by wait4() is 2604.4
# while last known CPU time is 3897.27
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 3897.27
CPU user time (s): 3897.04
CPU system time (s): 0.23
CPU usage (%): 299.787
Max. virtual memory (cumulated for all children) (KiB): 2104540

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2604.26
system time used= 0.147977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 102731
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 276
involuntary context switches= 8360

runsolver used 2.14067 second user time and 4.95425 second system time

The end

Launcher Data 

Begin job on node120 at 2011-04-29 13:34:27
IDJOB=3191273
IDBENCH=83004
IDSOLVER=1612
FILE ID=node120/3191273-1304076867
RUNJOBID= node120-1304076866-31755
PBS_JOBID= 13170475
Free space on /tmp= 72064 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S1836400953-011.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191273-1304076867/watcher-3191273-1304076867 -o /tmp/evaluation-result-3191273-1304076867/solver-3191273-1304076867 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191273-1304076867.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 39542bd0a185b4f7c5fc7900079a2845
RANDOM SEED=577254221

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31455600 kB
Buffers:        456244 kB
Cached:         607964 kB
SwapCached:          8 kB
Active:         416860 kB
Inactive:       718192 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31455600 kB
SwapTotal:    67111528 kB
SwapFree:     67111404 kB
Dirty:           20308 kB
Writeback:           0 kB
AnonPages:       70212 kB
Mapped:          15856 kB
Slab:           296736 kB
PageTables:       5100 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 14555808 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72056 MiB
End job on node120 at 2011-04-29 13:56:09