Trace number 3190958

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.12 1201.91

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S58287803-001-UNKNOWN.cnf
MD5SUM0d5d355ade4a956f83626786ca6018b7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.00/0.05	This is pico-portfolio, a naive parallel portfolio
0.00/0.05	Copyright (C) 2011 Olivier Roussel
0.00/0.05	Using 4 processing units
0.00/0.05	This portfolio uses the following solvers:
0.00/0.05	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.05	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.05	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.05	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.05	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.05	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.05	Starting clasp 1.3.6 on core(s) 4
0.00/0.05	Starting TNM 2009 on core(s) 6
0.00/0.05	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.05	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3190958-1304048800/watcher-3190958-1304048800 -o /tmp/evaluation-result-3190958-1304048800/solver-3190958-1304048800 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3190958-1304048800.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.27 10.20 10.11 6/182 25489
/proc/meminfo: memFree=25771684/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) R 25487 25489 25027 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0

[startup+0.220388 s]
/proc/loadavg: 10.27 10.20 10.11 6/182 25489
/proc/meminfo: memFree=25771684/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) R 25487 25489 25027 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300342 s]
/proc/loadavg: 10.27 10.20 10.11 6/182 25489
/proc/meminfo: memFree=25771684/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) R 25487 25489 25027 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.400323 s]
/proc/loadavg: 10.27 10.20 10.11 6/182 25489
/proc/meminfo: memFree=25771684/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) R 25487 25489 25027 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700272 s]
/proc/loadavg: 10.27 10.20 10.11 6/182 25489
/proc/meminfo: memFree=25771684/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) R 25487 25489 25027 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50113 s]
/proc/loadavg: 10.27 10.20 10.11 11/188 25495
/proc/meminfo: memFree=25747332/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 18 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=82960 CPUtime=1.49 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 5295 0 0 0 148 1 0 0 25 0 1 0 516477986 84951040 1876 33554432000 4194304 4587354 140734855907248 18446744073709551615 4241101 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 20740 1876 327 96 0 17302 0
[pid=25491] ppid=25489 vsize=19628 CPUtime=1.49 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 2424 0 0 0 149 0 0 0 25 0 1 0 516477986 20099072 2235 33554432000 4194304 4785740 140733445724896 18446744073709551615 4287124 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 4907 2235 340 145 0 1952 0
[pid=25492] ppid=25489 vsize=454504 CPUtime=0.71 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 998 0 0 0 71 0 0 0 25 0 1 0 516477986 465412096 894 33554432000 134512640 134534564 4294662096 18446744073709551615 134524712 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 113626 894 91 6 0 112292 0
[pid=25493] ppid=25489 vsize=6952 CPUtime=1.49 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 1660 0 0 0 149 0 0 0 20 0 1 0 516477986 7118848 915 33554432000 4194304 4352236 140735025819840 18446744073709551615 4328191 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 1738 915 127 39 0 818 0
[pid=25494] ppid=25489 vsize=10204 CPUtime=0.77 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 3929 0 0 0 77 0 0 0 25 0 1 0 516477986 10448896 916 33554432000 4194304 4331988 140735847293008 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 2551 916 150 34 0 993 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 592572

[startup+3.10085 s]
/proc/loadavg: 10.25 10.20 10.11 11/188 25495
/proc/meminfo: memFree=25745704/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=102316 CPUtime=3.09 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 11013 0 0 0 307 2 0 0 25 0 1 0 516477986 104771584 5758 33554432000 4194304 4587354 140734855907248 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 25579 5758 337 96 0 22141 0
[pid=25491] ppid=25489 vsize=21120 CPUtime=3.09 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 2785 0 0 0 309 0 0 0 25 0 1 0 516477986 21626880 2596 33554432000 4194304 4785740 140733445724896 18446744073709551615 4553399 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 5280 2596 340 145 0 2325 0
[pid=25492] ppid=25489 vsize=454504 CPUtime=1.51 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 998 0 0 0 151 0 0 0 25 0 1 0 516477986 465412096 894 33554432000 134512640 134534564 4294662096 18446744073709551615 134524554 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 113626 894 91 6 0 112292 0
[pid=25493] ppid=25489 vsize=7592 CPUtime=3.08 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 1836 0 0 0 308 0 0 0 25 0 1 0 516477986 7774208 1091 33554432000 4194304 4352236 140735025819840 18446744073709551615 4278697 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 1898 1091 127 39 0 978 0
[pid=25494] ppid=25489 vsize=13112 CPUtime=1.56 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 4651 0 0 0 156 0 0 0 25 0 1 0 516477986 13426688 1325 33554432000 4194304 4331988 140735847293008 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 3278 1325 170 34 0 1720 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 616968

[startup+6.30029 s]
/proc/loadavg: 10.25 10.20 10.11 11/188 25495
/proc/meminfo: memFree=25724376/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=100732 CPUtime=6.29 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 12347 0 0 0 627 2 0 0 25 0 1 0 516477986 103149568 6015 33554432000 4194304 4587354 140734855907248 18446744073709551615 4388352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 25183 6015 337 96 0 21745 0
[pid=25491] ppid=25489 vsize=23364 CPUtime=6.28 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 3339 0 0 0 628 0 0 0 25 0 1 0 516477986 23924736 3150 33554432000 4194304 4785740 140733445724896 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 5841 3150 340 145 0 2886 0
[pid=25492] ppid=25489 vsize=454504 CPUtime=3.11 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 998 0 0 0 311 0 0 0 25 0 1 0 516477986 465412096 894 33554432000 134512640 134534564 4294662096 18446744073709551615 134524554 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 113626 894 91 6 0 112292 0
[pid=25493] ppid=25489 vsize=8512 CPUtime=6.28 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 2095 0 0 0 628 0 0 0 25 0 1 0 516477986 8716288 1321 33554432000 4194304 4352236 140735025819840 18446744073709551615 4267809 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 2128 1321 127 39 0 1208 0
[pid=25494] ppid=25489 vsize=13112 CPUtime=3.14 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 4802 0 0 0 314 0 0 0 25 0 1 0 516477986 13426688 1476 33554432000 4194304 4331988 140735847293008 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 3278 1476 174 34 0 1720 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 618548

[startup+12.7012 s]
/proc/loadavg: 10.21 10.19 10.11 11/188 25495
/proc/meminfo: memFree=25714484/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=104888 CPUtime=12.69 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 16657 0 0 0 1266 3 0 0 25 0 1 0 516477986 107405312 6367 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238573 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 26222 6367 337 96 0 22784 0
[pid=25491] ppid=25489 vsize=26392 CPUtime=12.68 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 4057 0 0 0 1268 0 0 0 25 0 1 0 516477986 27025408 3868 33554432000 4194304 4785740 140733445724896 18446744073709551615 4287055 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 6598 3868 340 145 0 3643 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=6.31 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 631 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134530712 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=8072 CPUtime=12.68 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 2753 0 0 0 1268 0 0 0 25 0 1 0 516477986 8265728 1211 33554432000 4194304 4352236 140735025819840 18446744073709551615 4328059 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 2018 1211 127 39 0 1098 0
[pid=25494] ppid=25489 vsize=13112 CPUtime=6.31 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 4802 0 0 0 631 0 0 0 25 0 1 0 516477986 13426688 1476 33554432000 4194304 4331988 140735847293008 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 3278 1476 174 34 0 1720 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 629396

[startup+25.5069 s]
/proc/loadavg: 10.17 10.18 10.11 11/188 25496
/proc/meminfo: memFree=25699100/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=115180 CPUtime=25.49 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 23560 0 0 0 2545 4 0 0 25 0 1 0 516477986 117944320 10172 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 28795 10172 337 96 0 25357 0
[pid=25491] ppid=25489 vsize=30524 CPUtime=25.49 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 5002 0 0 0 2548 1 0 0 25 0 1 0 516477986 31256576 4813 33554432000 4194304 4785740 140733445724896 18446744073709551615 4549845 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 7631 4813 340 145 0 4676 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=12.66 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 1266 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134528864 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=8328 CPUtime=25.49 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 4193 0 0 0 2549 0 0 0 25 0 1 0 516477986 8527872 1275 33554432000 4194304 4352236 140735025819840 18446744073709551615 4329205 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 2082 1275 127 39 0 1162 0
[pid=25494] ppid=25489 vsize=14648 CPUtime=12.69 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 5071 0 0 0 1269 0 0 0 25 0 1 0 516477986 14999552 1745 33554432000 4194304 4331988 140735847293008 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 3662 1745 174 34 0 2104 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 645612

[startup+51.1005 s]
/proc/loadavg: 10.26 10.20 10.11 11/188 25496
/proc/meminfo: memFree=25693720/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=102876 CPUtime=51.08 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 32566 0 0 0 5102 6 0 0 25 0 1 0 516477986 105345024 8917 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 25719 8917 337 96 0 22281 0
[pid=25491] ppid=25489 vsize=36836 CPUtime=51.09 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 6464 0 0 0 5108 1 0 0 25 0 1 0 516477986 37720064 6275 33554432000 4194304 4785740 140733445724896 18446744073709551615 4287096 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 9209 6275 340 145 0 6254 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=25.4 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 2540 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134530339 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=8536 CPUtime=51.07 cores=2

################
# More data... #
################

/proc/25494/statm: 18012 13658 175 34 0 16454 0
Current children cumulated CPU time (s) 3763.94
Current children cumulated vsize (KiB) 815064

[startup+1002.31 s]
/proc/loadavg: 10.21 10.18 10.12 11/188 25564
/proc/meminfo: memFree=25874340/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=161424 CPUtime=1002.28 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 331514 0 0 0 100116 112 0 0 25 0 1 0 516477986 165298176 13353 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 40356 13353 337 96 0 36918 0
[pid=25491] ppid=25489 vsize=90900 CPUtime=1002.31 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 18761 0 0 0 100227 4 0 0 25 0 1 0 516477986 93081600 18319 33554432000 4194304 4785740 140733445724896 18446744073709551615 4287158 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 22725 18319 341 145 0 19770 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=498.42 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 49842 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134528288 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=19328 CPUtime=1002.2 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 44565 0 0 0 100213 7 0 0 25 0 1 0 516477986 19791872 4014 33554432000 4194304 4352236 140735025819840 18446744073709551615 4328095 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 4832 4014 127 39 0 3912 0
[pid=25494] ppid=25489 vsize=72048 CPUtime=498.42 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 17790 0 0 0 49834 8 0 0 25 0 1 0 516477986 73777152 14464 33554432000 4194304 4331988 140735847293008 18446744073709551615 4287447 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 18012 14464 175 34 0 16454 0
Current children cumulated CPU time (s) 4003.63
Current children cumulated vsize (KiB) 820632

[startup+1062.3 s]
/proc/loadavg: 10.34 10.22 10.13 12/189 25568
/proc/meminfo: memFree=25857320/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=161544 CPUtime=1062.19 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 345968 0 0 0 106100 119 0 0 25 0 1 0 516477986 165421056 14358 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 40386 14358 337 96 0 36948 0
[pid=25491] ppid=25489 vsize=92196 CPUtime=1062.31 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 19161 0 0 0 106227 4 0 0 25 0 1 0 516477986 94408704 18566 33554432000 4194304 4785740 140733445724896 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 23049 18566 341 145 0 20094 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=528.22 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 52822 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134530598 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=19328 CPUtime=1062.19 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 45365 0 0 0 106212 7 0 0 25 0 1 0 516477986 19791872 4014 33554432000 4194304 4352236 140735025819840 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 4832 4014 127 39 0 3912 0
[pid=25494] ppid=25489 vsize=72048 CPUtime=528.28 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 18605 0 0 0 52820 8 0 0 25 0 1 0 516477986 73777152 15279 33554432000 4194304 4331988 140735847293008 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 18012 15279 175 34 0 16454 0
Current children cumulated CPU time (s) 4243.19
Current children cumulated vsize (KiB) 822048

[startup+1122.3 s]
/proc/loadavg: 10.41 10.27 10.16 11/188 25570
/proc/meminfo: memFree=25857324/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=161724 CPUtime=1121.47 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 361483 0 0 0 112021 126 0 0 25 0 1 0 516477986 165605376 9253 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 40431 9253 337 96 0 36993 0
[pid=25491] ppid=25489 vsize=94568 CPUtime=1122.31 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 19700 0 0 0 112227 4 0 0 25 0 1 0 516477986 96837632 19105 33554432000 4194304 4785740 140733445724896 18446744073709551615 4551074 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 23642 19105 341 145 0 20687 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=558.07 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 55807 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=19328 CPUtime=1122.19 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 46165 0 0 0 112211 8 0 0 25 0 1 0 516477986 19791872 4014 33554432000 4194304 4352236 140735025819840 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 4832 4014 127 39 0 3912 0
[pid=25494] ppid=25489 vsize=72048 CPUtime=558.11 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 19427 0 0 0 55802 9 0 0 25 0 1 0 516477986 73777152 16101 33554432000 4194304 4331988 140735847293008 18446744073709551615 4226434 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 18012 16101 175 34 0 16454 0
Current children cumulated CPU time (s) 4482.15
Current children cumulated vsize (KiB) 824600

[startup+1182.3 s]
/proc/loadavg: 10.25 10.25 10.15 11/188 25572
/proc/meminfo: memFree=25831132/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=113572 CPUtime=1181.46 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 375834 0 0 0 118014 132 0 0 25 0 1 0 516477986 116297728 9390 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 28393 9390 337 96 0 24955 0
[pid=25491] ppid=25489 vsize=96372 CPUtime=1182.31 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 20103 0 0 0 118227 4 0 0 25 0 1 0 516477986 98684928 19508 33554432000 4194304 4785740 140733445724896 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 24093 19508 341 145 0 21138 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=587.92 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 58792 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=22528 CPUtime=1182.18 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 46965 0 0 0 118210 8 0 0 25 0 1 0 516477986 23068672 4814 33554432000 4194304 4352236 140735025819840 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 5632 4814 127 39 0 4712 0
[pid=25494] ppid=25489 vsize=101516 CPUtime=587.94 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 20228 0 0 0 58785 9 0 0 25 0 1 0 516477986 103952384 16902 33554432000 4194304 4331988 140735847293008 18446744073709551615 4237416 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 25379 16902 175 34 0 23821 0
Current children cumulated CPU time (s) 4721.81
Current children cumulated vsize (KiB) 810920



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 10.25 10.25 10.16 11/188 25572
/proc/meminfo: memFree=25838064/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=113572 CPUtime=1201.07 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 379842 0 0 0 119973 134 0 0 25 0 1 0 516477986 116297728 13345 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 28393 13345 337 96 0 24955 0
[pid=25491] ppid=25489 vsize=98552 CPUtime=1201.92 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 20574 0 0 0 120188 4 0 0 25 0 1 0 516477986 100917248 19979 33554432000 4194304 4785740 140733445724896 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 24638 19979 341 145 0 21683 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=597.65 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 59765 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=19328 CPUtime=1201.78 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 46965 0 0 0 120170 8 0 0 25 0 1 0 516477986 19791872 4014 33554432000 4194304 4352236 140735025819840 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 4832 4014 127 39 0 3912 0
[pid=25494] ppid=25489 vsize=102848 CPUtime=597.7 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 20649 0 0 0 59761 9 0 0 25 0 1 0 516477986 105316352 17323 33554432000 4194304 4331988 140735847293008 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 25712 17323 175 34 0 24154 0
Current children cumulated CPU time (s) 4800.12
Current children cumulated vsize (KiB) 811232

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.9 s]
/proc/loadavg: 10.25 10.25 10.16 11/188 25572
/proc/meminfo: memFree=25838064/32951124 swapFree=67111364/67111528
[pid=25489] ppid=25487 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25489/stat : 25489 (ppfolio) S 25487 25489 25027 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 516477986 18763776 390 33554432000 4194304 4287625 140736788838128 18446744073709551615 228244368911 0 0 4096 65536 1983237780704067583 0 0 17 2 0 0 0
/proc/25489/statm: 4581 390 341 23 0 91 0
[pid=25490] ppid=25489 vsize=113572 CPUtime=1201.07 cores=0
/proc/25490/stat : 25490 (cryptominisat) R 25489 25489 25027 0 -1 4202496 379842 0 0 0 119973 134 0 0 25 0 1 0 516477986 116297728 13345 33554432000 4194304 4587354 140734855907248 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25490/statm: 28393 13345 337 96 0 24955 0
[pid=25491] ppid=25489 vsize=98552 CPUtime=1201.92 cores=4
/proc/25491/stat : 25491 (clasp) R 25489 25489 25027 0 -1 4202496 20574 0 0 0 120188 4 0 0 25 0 1 0 516477986 100917248 19979 33554432000 4194304 4785740 140733445724896 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25491/statm: 24638 19979 341 145 0 21683 0
[pid=25492] ppid=25489 vsize=458608 CPUtime=597.65 cores=6
/proc/25492/stat : 25492 (TNM) R 25489 25489 25027 0 -1 4202496 1200 0 0 0 59765 0 0 0 25 0 1 0 516477986 469614592 1096 33554432000 134512640 134534564 4294662096 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25492/statm: 114652 1096 95 6 0 113318 0
[pid=25493] ppid=25489 vsize=19328 CPUtime=1201.78 cores=2
/proc/25493/stat : 25493 (lingeling) R 25489 25489 25027 0 -1 4202496 46965 0 0 0 120170 8 0 0 25 0 1 0 516477986 19791872 4014 33554432000 4194304 4352236 140735025819840 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25493/statm: 4832 4014 127 39 0 3912 0
[pid=25494] ppid=25489 vsize=102848 CPUtime=597.7 cores=6
/proc/25494/stat : 25494 (march_hi) R 25489 25489 25027 0 -1 4202496 20649 0 0 0 59761 9 0 0 25 0 1 0 516477986 105316352 17323 33554432000 4194304 4331988 140735847293008 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25494/statm: 25712 17323 175 34 0 24154 0
Current children cumulated CPU time (s) 4800.12
Current children cumulated vsize (KiB) 811232

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25489 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.004998
# while last known CPU time is 4800.12
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.91
CPU time (s): 4800.12
CPU user time (s): 4798.57
CPU system time (s): 1.55
CPU usage (%): 399.373
Max. virtual memory (cumulated for all children) (KiB): 3020300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 522
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 363
involuntary context switches= 6

runsolver used 1.76373 second user time and 4.80227 second system time

The end

Launcher Data 

Begin job on node136 at 2011-04-29 05:46:40
IDJOB=3190958
IDBENCH=82689
IDSOLVER=1612
FILE ID=node136/3190958-1304048800
RUNJOBID= node136-1304044537-25045
PBS_JOBID= 13170391
Free space on /tmp= 72324 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S58287803-001-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3190958-1304048800/watcher-3190958-1304048800 -o /tmp/evaluation-result-3190958-1304048800/solver-3190958-1304048800 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3190958-1304048800.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0d5d355ade4a956f83626786ca6018b7
RANDOM SEED=145979581

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25772088 kB
Buffers:       1054920 kB
Cached:        5011396 kB
SwapCached:        100 kB
Active:        1183556 kB
Inactive:      5443580 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25772088 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           10508 kB
Writeback:          20 kB
AnonPages:      560616 kB
Mapped:          16708 kB
Slab:           486196 kB
PageTables:       6128 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  3154988 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72312 MiB
End job on node136 at 2011-04-29 06:06:44