Trace number 3273634

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.35 1201.73

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n150-s89334302-unsat.cnf
MD5SUMe0b064ae815c6a8bb8a9898180562bec
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables153
Number of clauses316
Sum of the clauses size948
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3316
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273634-1304082305/watcher-3273634-1304082305 -o /tmp/evaluation-result-3273634-1304082305/solver-3273634-1304082305 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3273634-1304082305.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.54 8.22 8.27 6/181 16002
/proc/meminfo: memFree=25715608/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) R 16000 16002 15268 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0

[startup+0.467635 s]
/proc/loadavg: 8.54 8.22 8.27 6/181 16002
/proc/meminfo: memFree=25715608/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.500627 s]
/proc/loadavg: 8.54 8.22 8.27 6/181 16002
/proc/meminfo: memFree=25715608/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.600609 s]
/proc/loadavg: 8.54 8.22 8.27 6/181 16002
/proc/meminfo: memFree=25715608/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700589 s]
/proc/loadavg: 8.54 8.22 8.27 6/181 16002
/proc/meminfo: memFree=25715608/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 20 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50644 s]
/proc/loadavg: 8.57 8.23 8.27 10/187 16008
/proc/meminfo: memFree=25700076/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=192756 CPUtime=1.49 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 3857 0 0 0 149 0 0 0 25 0 1 0 519830215 197382144 2107 33554432000 4194304 4587354 140734944914896 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 48189 2107 337 96 0 44751 0
[pid=16004] ppid=16002 vsize=12692 CPUtime=1.5 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 649 0 0 0 150 0 0 0 25 0 1 0 519830215 12996608 539 33554432000 4194304 4785740 140735482267152 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3173 539 341 145 0 218 0
[pid=16005] ppid=16002 vsize=455696 CPUtime=0.84 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 273 0 0 0 84 0 0 0 25 0 1 0 519830215 466632704 169 33554432000 134512640 134534564 4294217968 18446744073709551615 134528620 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113924 169 95 6 0 112590 0
[pid=16006] ppid=16002 vsize=8052 CPUtime=1.49 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 1443 0 0 0 149 0 0 0 25 0 1 0 519830215 8245248 1211 33554432000 4194304 4352236 140735610797440 18446744073709551615 4207805 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 2013 1211 127 39 0 1093 0
[pid=16007] ppid=16002 vsize=7560 CPUtime=0.64 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 510 0 0 0 64 0 0 0 25 0 1 0 519830215 7741440 402 33554432000 4194304 4331988 140733878285120 18446744073709551615 4309005 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 1890 402 173 34 0 332 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 695080

[startup+3.10113 s]
/proc/loadavg: 8.57 8.23 8.27 10/187 16008
/proc/meminfo: memFree=25694992/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=195944 CPUtime=3.09 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 5740 0 0 0 309 0 0 0 25 0 1 0 519830215 200646656 3049 33554432000 4194304 4587354 140734944914896 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 48986 3049 337 96 0 45548 0
[pid=16004] ppid=16002 vsize=12960 CPUtime=3.09 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 695 0 0 0 309 0 0 0 25 0 1 0 519830215 13271040 585 33554432000 4194304 4785740 140735482267152 18446744073709551615 4416791 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3240 585 341 145 0 285 0
[pid=16005] ppid=16002 vsize=455696 CPUtime=1.64 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 273 0 0 0 164 0 0 0 25 0 1 0 519830215 466632704 169 33554432000 134512640 134534564 4294217968 18446744073709551615 134528902 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113924 169 95 6 0 112590 0
[pid=16006] ppid=16002 vsize=8184 CPUtime=3.09 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 1924 0 0 0 309 0 0 0 25 0 1 0 519830215 8380416 1244 33554432000 4194304 4352236 140735610797440 18446744073709551615 4328055 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 2046 1244 127 39 0 1126 0
[pid=16007] ppid=16002 vsize=7900 CPUtime=1.43 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 659 0 0 0 143 0 0 0 25 0 1 0 519830215 8089600 551 33554432000 4194304 4331988 140733878285120 18446744073709551615 4229469 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 1975 551 173 34 0 417 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 699008

[startup+6.30052 s]
/proc/loadavg: 8.57 8.23 8.27 10/187 16008
/proc/meminfo: memFree=25688460/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=196540 CPUtime=6.28 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 8872 0 0 0 628 0 0 0 25 0 1 0 519830215 201256960 3060 33554432000 4194304 4587354 140734944914896 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 49135 3060 337 96 0 45697 0
[pid=16004] ppid=16002 vsize=13224 CPUtime=6.29 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 767 0 0 0 629 0 0 0 25 0 1 0 519830215 13541376 657 33554432000 4194304 4785740 140735482267152 18446744073709551615 4299680 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3306 657 341 145 0 351 0
[pid=16005] ppid=16002 vsize=455696 CPUtime=3.24 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 273 0 0 0 324 0 0 0 25 0 1 0 519830215 466632704 169 33554432000 134512640 134534564 4294217968 18446744073709551615 8029589 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113924 169 95 6 0 112590 0
[pid=16006] ppid=16002 vsize=10840 CPUtime=6.28 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 3524 0 0 0 628 0 0 0 25 0 1 0 519830215 11100160 1908 33554432000 4194304 4352236 140735610797440 18446744073709551615 4329043 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 2710 1908 127 39 0 1790 0
[pid=16007] ppid=16002 vsize=9360 CPUtime=3 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 965 0 0 0 300 0 0 0 25 0 1 0 519830215 9584640 857 33554432000 4194304 4331988 140733878285120 18446744073709551615 4226499 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 2340 857 173 34 0 782 0
Current children cumulated CPU time (s) 25.09
Current children cumulated vsize (KiB) 703984

[startup+12.7003 s]
/proc/loadavg: 8.72 8.28 8.28 10/187 16008
/proc/meminfo: memFree=25675232/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=203364 CPUtime=12.69 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 14845 0 0 0 1268 1 0 0 25 0 1 0 519830215 208244736 4854 33554432000 4194304 4587354 140734944914896 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 50841 4854 337 96 0 47403 0
[pid=16004] ppid=16002 vsize=13492 CPUtime=12.69 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 846 0 0 0 1269 0 0 0 25 0 1 0 519830215 13815808 736 33554432000 4194304 4785740 140735482267152 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3373 736 341 145 0 418 0
[pid=16005] ppid=16002 vsize=455696 CPUtime=6.41 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 273 0 0 0 641 0 0 0 25 0 1 0 519830215 466632704 169 33554432000 134512640 134534564 4294217968 18446744073709551615 134529838 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113924 169 95 6 0 112590 0
[pid=16006] ppid=16002 vsize=11484 CPUtime=12.68 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 5221 0 0 0 1268 0 0 0 25 0 1 0 519830215 11759616 2069 33554432000 4194304 4352236 140735610797440 18446744073709551615 4328166 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 2871 2069 127 39 0 1951 0
[pid=16007] ppid=16002 vsize=12416 CPUtime=6.2 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 1534 0 0 0 620 0 0 0 25 0 1 0 519830215 12713984 1426 33554432000 4194304 4331988 140733878285120 18446744073709551615 4229623 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 3104 1426 173 34 0 1546 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 714776

[startup+25.5009 s]
/proc/loadavg: 8.76 8.30 8.29 6/181 16010
/proc/meminfo: memFree=26224744/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=214664 CPUtime=25.49 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 23199 0 0 0 2547 2 0 0 25 0 1 0 519830215 219815936 7973 33554432000 4194304 4587354 140734944914896 18446744073709551615 4232133 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 53666 7973 337 96 0 50228 0
[pid=16004] ppid=16002 vsize=14028 CPUtime=25.49 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 959 0 0 0 2549 0 0 0 25 0 1 0 519830215 14364672 849 33554432000 4194304 4785740 140735482267152 18446744073709551615 4287055 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3507 849 341 145 0 552 0
[pid=16005] ppid=16002 vsize=455696 CPUtime=12.75 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 273 0 0 0 1275 0 0 0 25 0 1 0 519830215 466632704 169 33554432000 134512640 134534564 4294217968 18446744073709551615 134530568 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113924 169 95 6 0 112590 0
[pid=16006] ppid=16002 vsize=17500 CPUtime=25.49 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 9253 0 0 0 2548 1 0 0 25 0 1 0 519830215 17920000 3573 33554432000 4194304 4352236 140735610797440 18446744073709551615 4328205 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 4375 3573 127 39 0 3455 0
[pid=16007] ppid=16002 vsize=19244 CPUtime=12.6 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 2665 0 0 0 1259 1 0 0 25 0 1 0 519830215 19705856 2557 33554432000 4194304 4331988 140733878285120 18446744073709551615 4316645 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 4811 2557 173 34 0 3253 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 739456

[startup+51.101 s]
/proc/loadavg: 9.18 8.43 8.33 11/188 16042
/proc/meminfo: memFree=26165320/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=221360 CPUtime=51.08 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 33271 0 0 0 5105 3 0 0 25 0 1 0 519830215 226672640 9984 33554432000 4194304 4587354 140734944914896 18446744073709551615 4232088 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 55340 9984 337 96 0 51902 0
[pid=16004] ppid=16002 vsize=14564 CPUtime=51.09 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 1099 0 0 0 5109 0 0 0 25 0 1 0 519830215 14913536 989 33554432000 4194304 4785740 140735482267152 18446744073709551615 4553743 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3641 989 341 145 0 686 0
[pid=16005] ppid=16002 vsize=455696 CPUtime=25.51 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 273 0 0 0 2551 0 0 0 25 0 1 0 519830215 466632704 169 33554432000 134512640 134534564 4294217968 18446744073709551615 134529267 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113924 169 95 6 0 112590 0
[pid=16006] ppid=16002 vsize=13684 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/16007/statm: 87917 80830 173 34 0 86359 0
Current children cumulated CPU time (s) 3764.12
Current children cumulated vsize (KiB) 1167464

[startup+1002.3 s]
/proc/loadavg: 10.11 10.07 9.48 11/188 16068
/proc/meminfo: memFree=25284460/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=360216 CPUtime=1002.32 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 222936 0 0 0 100192 40 0 0 25 0 1 0 519830215 368861184 30343 33554432000 4194304 4587354 140734944914896 18446744073709551615 4357555 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 90054 30343 337 96 0 86616 0
[pid=16004] ppid=16002 vsize=15896 CPUtime=1002.3 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 1423 0 0 0 100230 0 0 0 25 0 1 0 519830215 16277504 1313 33554432000 4194304 4785740 140735482267152 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3974 1313 341 145 0 1019 0
[pid=16005] ppid=16002 vsize=455700 CPUtime=498.53 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 282 0 0 0 49853 0 0 0 25 0 1 0 519830215 466636800 178 33554432000 134512640 134534564 4294217968 18446744073709551615 134528719 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113925 178 103 6 0 112591 0
[pid=16006] ppid=16002 vsize=38008 CPUtime=1002.33 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 110056 0 0 0 100220 13 0 0 25 0 1 0 519830215 38920192 8700 33554432000 4194304 4352236 140735610797440 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 9502 8700 127 39 0 8582 0
[pid=16007] ppid=16002 vsize=500844 CPUtime=498.32 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 85871 0 0 0 49806 26 0 0 25 0 1 0 519830215 512864256 85763 33554432000 4194304 4331988 140733878285120 18446744073709551615 4288464 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 125211 85763 173 34 0 123653 0
Current children cumulated CPU time (s) 4003.8
Current children cumulated vsize (KiB) 1388988

[startup+1062.3 s]
/proc/loadavg: 10.20 10.10 9.53 11/188 16069
/proc/meminfo: memFree=25245128/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=353556 CPUtime=1062.32 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 227010 0 0 0 106191 41 0 0 25 0 1 0 519830215 362041344 29518 33554432000 4194304 4587354 140734944914896 18446744073709551615 4231426 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 88389 29518 337 96 0 84951 0
[pid=16004] ppid=16002 vsize=15896 CPUtime=1062.3 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 1431 0 0 0 106230 0 0 0 25 0 1 0 519830215 16277504 1321 33554432000 4194304 4785740 140735482267152 18446744073709551615 4552974 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3974 1321 341 145 0 1019 0
[pid=16005] ppid=16002 vsize=455700 CPUtime=528.36 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 282 0 0 0 52836 0 0 0 25 0 1 0 519830215 466636800 178 33554432000 134512640 134534564 4294217968 18446744073709551615 134528659 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113925 178 103 6 0 112591 0
[pid=16006] ppid=16002 vsize=37624 CPUtime=1062.32 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 115368 0 0 0 106219 13 0 0 25 0 1 0 519830215 38526976 8604 33554432000 4194304 4352236 140735610797440 18446744073709551615 4328385 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 9406 8604 127 39 0 8486 0
[pid=16007] ppid=16002 vsize=500844 CPUtime=528.16 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 90902 0 0 0 52787 29 0 0 25 0 1 0 519830215 512864256 90794 33554432000 4194304 4331988 140733878285120 18446744073709551615 4240407 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 125211 90794 173 34 0 123653 0
Current children cumulated CPU time (s) 4243.46
Current children cumulated vsize (KiB) 1381944

[startup+1122.3 s]
/proc/loadavg: 10.26 10.13 9.57 11/188 16071
/proc/meminfo: memFree=25205428/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=353556 CPUtime=1122.34 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 227579 0 0 0 112192 42 0 0 25 0 1 0 519830215 362041344 29294 33554432000 4194304 4587354 140734944914896 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 88389 29294 337 96 0 84951 0
[pid=16004] ppid=16002 vsize=15896 CPUtime=1122.31 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 1434 0 0 0 112231 0 0 0 25 0 1 0 519830215 16277504 1324 33554432000 4194304 4785740 140735482267152 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3974 1324 341 145 0 1019 0
[pid=16005] ppid=16002 vsize=455700 CPUtime=558.19 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 282 0 0 0 55819 0 0 0 25 0 1 0 519830215 466636800 178 33554432000 134512640 134534564 4294217968 18446744073709551615 8030619 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113925 178 103 6 0 112591 0
[pid=16006] ppid=16002 vsize=38136 CPUtime=1122.33 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 118984 0 0 0 112219 14 0 0 25 0 1 0 519830215 39051264 8732 33554432000 4194304 4352236 140735610797440 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 9534 8732 127 39 0 8614 0
[pid=16007] ppid=16002 vsize=500844 CPUtime=558.02 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 96044 0 0 0 55770 32 0 0 25 0 1 0 519830215 512864256 95936 33554432000 4194304 4331988 140733878285120 18446744073709551615 4314368 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 125211 95936 173 34 0 123653 0
Current children cumulated CPU time (s) 4483.19
Current children cumulated vsize (KiB) 1382456

[startup+1182.3 s]
/proc/loadavg: 10.27 10.15 9.61 11/188 16072
/proc/meminfo: memFree=25146612/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=296240 CPUtime=1182.33 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 228914 0 0 0 118191 42 0 0 25 0 1 0 519830215 303349760 29293 33554432000 4194304 4587354 140734944914896 18446744073709551615 4237684 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 74060 29293 337 96 0 70622 0
[pid=16004] ppid=16002 vsize=15896 CPUtime=1182.3 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 1437 0 0 0 118230 0 0 0 25 0 1 0 519830215 16277504 1327 33554432000 4194304 4785740 140735482267152 18446744073709551615 4309557 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3974 1327 341 145 0 1019 0
[pid=16005] ppid=16002 vsize=455700 CPUtime=588.05 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 282 0 0 0 58805 0 0 0 25 0 1 0 519830215 466636800 178 33554432000 134512640 134534564 4294217968 18446744073709551615 134530712 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113925 178 103 6 0 112591 0
[pid=16006] ppid=16002 vsize=53496 CPUtime=1182.33 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 126344 0 0 0 118218 15 0 0 25 0 1 0 519830215 54779904 12572 33554432000 4194304 4352236 140735610797440 18446744073709551615 4328068 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 13374 12572 127 39 0 12454 0
[pid=16007] ppid=16002 vsize=500844 CPUtime=587.82 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 101174 0 0 0 58749 33 0 0 25 0 1 0 519830215 512864256 101066 33554432000 4194304 4331988 140733878285120 18446744073709551615 4246530 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 125211 101066 173 34 0 123653 0
Current children cumulated CPU time (s) 4722.83
Current children cumulated vsize (KiB) 1340500



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.25 10.15 9.62 11/188 16073
/proc/meminfo: memFree=25143748/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=353556 CPUtime=1201.74 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 229166 0 0 0 120132 42 0 0 25 0 1 0 519830215 362041344 29293 33554432000 4194304 4587354 140734944914896 18446744073709551615 4238778 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 88389 29293 337 96 0 84951 0
[pid=16004] ppid=16002 vsize=15896 CPUtime=1201.71 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 1443 0 0 0 120171 0 0 0 25 0 1 0 519830215 16277504 1333 33554432000 4194304 4785740 140735482267152 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3974 1333 341 145 0 1019 0
[pid=16005] ppid=16002 vsize=455700 CPUtime=597.66 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 282 0 0 0 59766 0 0 0 25 0 1 0 519830215 466636800 178 33554432000 134512640 134534564 4294217968 18446744073709551615 134529887 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113925 178 103 6 0 112591 0
[pid=16006] ppid=16002 vsize=42360 CPUtime=1201.73 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 127656 0 0 0 120158 15 0 0 25 0 1 0 519830215 43376640 9788 33554432000 4194304 4352236 140735610797440 18446744073709551615 4328055 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 10590 9788 127 39 0 9670 0
[pid=16007] ppid=16002 vsize=500844 CPUtime=597.51 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 102837 0 0 0 59718 33 0 0 25 0 1 0 519830215 512864256 102729 33554432000 4194304 4331988 140733878285120 18446744073709551615 4237176 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 125211 102729 173 34 0 123653 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 1386680

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 10.25 10.15 9.62 11/188 16073
/proc/meminfo: memFree=25143748/32950928 swapFree=67111364/67111528
[pid=16002] ppid=16000 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/16002/stat : 16002 (ppfolio) S 16000 16002 15268 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 519830215 18763776 390 33554432000 4194304 4287625 140737457358400 18446744073709551615 208080252431 0 0 4096 65536 4602370822772883455 0 0 17 1 0 0 0
/proc/16002/statm: 4581 390 341 23 0 91 0
[pid=16003] ppid=16002 vsize=353556 CPUtime=1201.74 cores=1
/proc/16003/stat : 16003 (cryptominisat) R 16002 16002 15268 0 -1 4202496 229166 0 0 0 120132 42 0 0 25 0 1 0 519830215 362041344 29293 33554432000 4194304 4587354 140734944914896 18446744073709551615 4238778 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/16003/statm: 88389 29293 337 96 0 84951 0
[pid=16004] ppid=16002 vsize=15896 CPUtime=1201.71 cores=5
/proc/16004/stat : 16004 (clasp) R 16002 16002 15268 0 -1 4202496 1443 0 0 0 120171 0 0 0 25 0 1 0 519830215 16277504 1333 33554432000 4194304 4785740 140735482267152 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/16004/statm: 3974 1333 341 145 0 1019 0
[pid=16005] ppid=16002 vsize=455700 CPUtime=597.66 cores=7
/proc/16005/stat : 16005 (TNM) R 16002 16002 15268 0 -1 4202496 282 0 0 0 59766 0 0 0 25 0 1 0 519830215 466636800 178 33554432000 134512640 134534564 4294217968 18446744073709551615 134529887 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16005/statm: 113925 178 103 6 0 112591 0
[pid=16006] ppid=16002 vsize=42360 CPUtime=1201.73 cores=3
/proc/16006/stat : 16006 (lingeling) R 16002 16002 15268 0 -1 4202496 127656 0 0 0 120158 15 0 0 25 0 1 0 519830215 43376640 9788 33554432000 4194304 4352236 140735610797440 18446744073709551615 4328055 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/16006/statm: 10590 9788 127 39 0 9670 0
[pid=16007] ppid=16002 vsize=500844 CPUtime=597.51 cores=7
/proc/16007/stat : 16007 (march_hi) R 16002 16002 15268 0 -1 4202496 102837 0 0 0 59718 33 0 0 25 0 1 0 519830215 512864256 102729 33554432000 4194304 4331988 140733878285120 18446744073709551615 4237176 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/16007/statm: 125211 102729 173 34 0 123653 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 1386680

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16002 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.005998
# while last known CPU time is 4800.35
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.73
CPU time (s): 4800.35
CPU user time (s): 4799.45
CPU system time (s): 0.9
CPU usage (%): 399.455
Max. virtual memory (cumulated for all children) (KiB): 1572040

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 524
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 491
involuntary context switches= 6

runsolver used 1.93271 second user time and 4.63129 second system time

The end

Launcher Data 

Begin job on node127 at 2011-04-29 15:05:05
IDJOB=3273634
IDBENCH=83143
IDSOLVER=1612
FILE ID=node127/3273634-1304082305
RUNJOBID= node127-1304077884-15287
PBS_JOBID= 13170516
Free space on /tmp= 71800 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n150-s89334302-unsat.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273634-1304082305/watcher-3273634-1304082305 -o /tmp/evaluation-result-3273634-1304082305/solver-3273634-1304082305 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3273634-1304082305.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e0b064ae815c6a8bb8a9898180562bec
RANDOM SEED=1927026743

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      25715896 kB
Buffers:       1394948 kB
Cached:        4733732 kB
SwapCached:          0 kB
Active:        2354128 kB
Inactive:      4403800 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      25715896 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           10300 kB
Writeback:           0 kB
AnonPages:      628832 kB
Mapped:          16532 kB
Slab:           411044 kB
PageTables:       5888 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  2036968 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71800 MiB
End job on node127 at 2011-04-29 15:25:09