Trace number 3191137

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.18 1201.71

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v650-c2769-S960948361-055.UNKNOWN.cnf
MD5SUMb51753a48e6efd66554e7afe4efc3b19
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables650
Number of clauses2769
Sum of the clauses size8307
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32769
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191137-1304060868/watcher-3191137-1304060868 -o /tmp/evaluation-result-3191137-1304060868/solver-3191137-1304060868 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191137-1304060868.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.95 10.03 9.69 6/182 3746
/proc/meminfo: memFree=18200952/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) R 3744 3746 2759 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0

[startup+0.310798 s]
/proc/loadavg: 9.95 10.03 9.69 6/182 3746
/proc/meminfo: memFree=18200952/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) R 3744 3746 2759 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.400781 s]
/proc/loadavg: 9.95 10.03 9.69 6/182 3746
/proc/meminfo: memFree=18200952/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) R 3744 3746 2759 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.500763 s]
/proc/loadavg: 9.95 10.03 9.69 6/182 3746
/proc/meminfo: memFree=18200952/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) R 3744 3746 2759 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700726 s]
/proc/loadavg: 9.95 10.03 9.69 6/182 3746
/proc/meminfo: memFree=18200952/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) R 3744 3746 2759 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50058 s]
/proc/loadavg: 9.95 10.03 9.69 11/188 3752
/proc/meminfo: memFree=18189744/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 18 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=725416 CPUtime=1.48 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 4122 0 0 0 148 0 0 0 25 0 1 0 517687215 742825984 2749 33554432000 4194304 4587354 140733328132496 18446744073709551615 4365232 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 181354 2749 337 96 0 177916 0
[pid=3748] ppid=3746 vsize=14312 CPUtime=1.49 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 1046 0 0 0 149 0 0 0 20 0 1 0 517687215 14655488 932 33554432000 4194304 4785740 140735469266192 18446744073709551615 4553083 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 3578 932 340 145 0 623 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=0.74 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 74 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 4961777 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=6636 CPUtime=1.49 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 1210 0 0 0 149 0 0 0 25 0 1 0 517687215 6795264 857 33554432000 4194304 4352236 140733425946192 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 1659 857 127 39 0 739 0
[pid=3751] ppid=3746 vsize=8200 CPUtime=0.73 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 651 0 0 0 73 0 0 0 25 0 1 0 517687215 8396800 543 33554432000 4194304 4331988 140737041259200 18446744073709551615 4229463 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 2050 543 172 34 0 492 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 1228848

[startup+3.10029 s]
/proc/loadavg: 9.95 10.03 9.69 11/188 3752
/proc/meminfo: memFree=18175608/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=728184 CPUtime=3.09 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 5937 0 0 0 308 1 0 0 25 0 1 0 517687215 745660416 3582 33554432000 4194304 4587354 140733328132496 18446744073709551615 4357656 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 182046 3582 337 96 0 178608 0
[pid=3748] ppid=3746 vsize=15244 CPUtime=3.09 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 1264 0 0 0 309 0 0 0 25 0 1 0 517687215 15609856 1150 33554432000 4194304 4785740 140735469266192 18446744073709551615 4553306 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 3811 1150 340 145 0 856 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=1.54 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 154 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134530652 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=6508 CPUtime=3.09 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 1242 0 0 0 309 0 0 0 25 0 1 0 517687215 6664192 825 33554432000 4194304 4352236 140733425946192 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 1627 825 127 39 0 707 0
[pid=3751] ppid=3746 vsize=8412 CPUtime=1.53 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 731 0 0 0 153 0 0 0 25 0 1 0 517687215 8613888 604 33554432000 4194304 4331988 140737041259200 18446744073709551615 4316799 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 2103 604 172 34 0 545 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 1232632

[startup+6.3007 s]
/proc/loadavg: 9.95 10.03 9.70 11/188 3752
/proc/meminfo: memFree=18168920/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=729760 CPUtime=6.28 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 8370 0 0 0 627 1 0 0 25 0 1 0 517687215 747274240 4152 33554432000 4194304 4587354 140733328132496 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 182440 4152 337 96 0 179002 0
[pid=3748] ppid=3746 vsize=16452 CPUtime=6.29 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 1575 0 0 0 629 0 0 0 25 0 1 0 517687215 16846848 1461 33554432000 4194304 4785740 140735469266192 18446744073709551615 4552952 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 4113 1461 341 145 0 1158 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=3.14 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 314 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134530286 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=6956 CPUtime=6.29 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 1802 0 0 0 629 0 0 0 25 0 1 0 517687215 7122944 905 33554432000 4194304 4352236 140733425946192 18446744073709551615 4329066 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 1739 905 127 39 0 819 0
[pid=3751] ppid=3746 vsize=8792 CPUtime=3.11 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 790 0 0 0 311 0 0 0 25 0 1 0 517687215 9003008 663 33554432000 4194304 4331988 140737041259200 18446744073709551615 4211487 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 2198 663 173 34 0 640 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 1236244

[startup+12.7005 s]
/proc/loadavg: 9.96 10.03 9.70 11/188 3752
/proc/meminfo: memFree=18165372/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=734528 CPUtime=12.69 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 12812 0 0 0 1266 3 0 0 25 0 1 0 517687215 752156672 4570 33554432000 4194304 4587354 140733328132496 18446744073709551615 4237686 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 183632 4570 337 96 0 180194 0
[pid=3748] ppid=3746 vsize=17956 CPUtime=12.69 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 1929 0 0 0 1269 0 0 0 25 0 1 0 517687215 18386944 1815 33554432000 4194304 4785740 140735469266192 18446744073709551615 4286973 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 4489 1815 341 145 0 1534 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=6.31 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 631 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134528288 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=8500 CPUtime=12.69 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 3036 0 0 0 1269 0 0 0 25 0 1 0 517687215 8704000 1307 33554432000 4194304 4352236 140733425946192 18446744073709551615 4208066 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 2125 1307 127 39 0 1205 0
[pid=3751] ppid=3746 vsize=9280 CPUtime=6.3 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 936 0 0 0 630 0 0 0 25 0 1 0 517687215 9502720 809 33554432000 4194304 4331988 140737041259200 18446744073709551615 4211480 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 2320 809 173 34 0 762 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 1244548

[startup+25.5012 s]
/proc/loadavg: 10.12 10.06 9.71 11/188 3753
/proc/meminfo: memFree=18145656/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=740040 CPUtime=25.49 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 19701 0 0 0 2546 3 0 0 25 0 1 0 517687215 757800960 6155 33554432000 4194304 4587354 140733328132496 18446744073709551615 4238512 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 185010 6155 337 96 0 181572 0
[pid=3748] ppid=3746 vsize=20316 CPUtime=25.49 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 2533 0 0 0 2549 0 0 0 25 0 1 0 517687215 20803584 2419 33554432000 4194304 4785740 140735469266192 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 5079 2419 341 145 0 2124 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=12.65 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 1265 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=12212 CPUtime=25.49 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 5980 0 0 0 2549 0 0 0 25 0 1 0 517687215 12505088 2235 33554432000 4194304 4352236 140733425946192 18446744073709551615 4207805 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 3053 2235 127 39 0 2133 0
[pid=3751] ppid=3746 vsize=10704 CPUtime=12.7 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 1184 0 0 0 1270 0 0 0 25 0 1 0 517687215 10960896 1057 33554432000 4194304 4331988 140737041259200 18446744073709551615 4263156 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 2676 1057 173 34 0 1118 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 1257556

[startup+51.1005 s]
/proc/loadavg: 10.08 10.06 9.72 11/188 3754
/proc/meminfo: memFree=18134572/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=738604 CPUtime=51.09 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 29254 0 0 0 5103 6 0 0 25 0 1 0 517687215 756330496 6547 33554432000 4194304 4587354 140733328132496 18446744073709551615 230808862398 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 184651 6547 337 96 0 181213 0
[pid=3748] ppid=3746 vsize=23272 CPUtime=51.09 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 3203 0 0 0 5109 0 0 0 25 0 1 0 517687215 23830528 3089 33554432000 4194304 4785740 140735469266192 18446744073709551615 4287140 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 5818 3089 341 145 0 2863 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=25.44 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 2544 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134530820 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=13240 CPUtime=51.09 cores=2

################
# More data... #
################

/proc/3751/statm: 21569 15808 173 34 0 20011 0
Current children cumulated CPU time (s) 3524.31
Current children cumulated vsize (KiB) 1435264

[startup+942.3 s]
/proc/loadavg: 10.19 10.15 9.96 11/188 3777
/proc/meminfo: memFree=17875692/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=822476 CPUtime=942.31 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 180768 0 0 0 94171 60 0 0 25 0 1 0 517687215 842215424 20706 33554432000 4194304 4587354 140733328132496 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 205619 20706 337 96 0 202181 0
[pid=3748] ppid=3746 vsize=47392 CPUtime=942.31 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 8778 0 0 0 94230 1 0 0 25 0 1 0 517687215 48529408 8664 33554432000 4194304 4785740 140735469266192 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 11848 8664 341 145 0 8893 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=468.64 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 46864 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=23232 CPUtime=942.19 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 74527 0 0 0 94210 9 0 0 25 0 1 0 517687215 23789568 4990 33554432000 4194304 4352236 140733425946192 18446744073709551615 4328126 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 5808 4990 127 39 0 4888 0
[pid=3751] ppid=3746 vsize=86276 CPUtime=468.53 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 16906 0 0 0 46846 7 0 0 25 0 1 0 517687215 88346624 16779 33554432000 4194304 4331988 140737041259200 18446744073709551615 4211509 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 21569 16779 173 34 0 20011 0
Current children cumulated CPU time (s) 3763.98
Current children cumulated vsize (KiB) 1453660

[startup+1002.3 s]
/proc/loadavg: 10.18 10.15 9.97 11/188 3779
/proc/meminfo: memFree=17860408/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=849156 CPUtime=1002.32 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 188365 0 0 0 100169 63 0 0 25 0 1 0 517687215 869535744 20086 33554432000 4194304 4587354 140733328132496 18446744073709551615 4238573 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 212289 20086 337 96 0 208851 0
[pid=3748] ppid=3746 vsize=47904 CPUtime=1002.32 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 8887 0 0 0 100231 1 0 0 25 0 1 0 517687215 49053696 8773 33554432000 4194304 4785740 140735469266192 18446744073709551615 4309557 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 11976 8773 341 145 0 9021 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=498.47 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 49847 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134528371 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=35776 CPUtime=1002.19 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 79007 0 0 0 100210 9 0 0 25 0 1 0 517687215 36634624 8126 33554432000 4194304 4352236 140733425946192 18446744073709551615 4328085 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 8944 8126 127 39 0 8024 0
[pid=3751] ppid=3746 vsize=86276 CPUtime=498.38 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 17858 0 0 0 49831 7 0 0 25 0 1 0 517687215 88346624 17731 33554432000 4194304 4331988 140737041259200 18446744073709551615 4226496 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 21569 17731 173 34 0 20011 0
Current children cumulated CPU time (s) 4003.68
Current children cumulated vsize (KiB) 1493396

[startup+1062.3 s]
/proc/loadavg: 10.17 10.15 9.98 11/188 3780
/proc/meminfo: memFree=17855184/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=822620 CPUtime=1062.32 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 194647 0 0 0 106166 66 0 0 25 0 1 0 517687215 842362880 22162 33554432000 4194304 4587354 140733328132496 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 205655 22162 337 96 0 202217 0
[pid=3748] ppid=3746 vsize=48412 CPUtime=1062.31 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 9024 0 0 0 106230 1 0 0 25 0 1 0 517687215 49573888 8910 33554432000 4194304 4785740 140735469266192 18446744073709551615 4552483 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 12103 8910 341 145 0 9148 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=528.3 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 52830 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=31424 CPUtime=1062.17 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 82655 0 0 0 106208 9 0 0 25 0 1 0 517687215 32178176 7038 33554432000 4194304 4352236 140733425946192 18446744073709551615 4328047 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 7856 7038 127 39 0 6936 0
[pid=3751] ppid=3746 vsize=86276 CPUtime=528.22 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 18765 0 0 0 52815 7 0 0 25 0 1 0 517687215 88346624 18638 33554432000 4194304 4331988 140737041259200 18446744073709551615 4211587 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 21569 18638 173 34 0 20011 0
Current children cumulated CPU time (s) 4243.32
Current children cumulated vsize (KiB) 1463016

[startup+1122.31 s]
/proc/loadavg: 9.98 10.09 9.97 11/188 3879
/proc/meminfo: memFree=18002244/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=822704 CPUtime=1122.33 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 202601 0 0 0 112163 70 0 0 25 0 1 0 517687215 842448896 21696 33554432000 4194304 4587354 140733328132496 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 205676 21696 337 96 0 202238 0
[pid=3748] ppid=3746 vsize=49424 CPUtime=1122.32 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 9237 0 0 0 112231 1 0 0 25 0 1 0 517687215 50610176 9123 33554432000 4194304 4785740 140735469266192 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 12356 9123 341 145 0 9401 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=558.16 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 55816 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134528200 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=34240 CPUtime=1122.17 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 84703 0 0 0 112207 10 0 0 25 0 1 0 517687215 35061760 7742 33554432000 4194304 4352236 140733425946192 18446744073709551615 4329024 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 8560 7742 127 39 0 7640 0
[pid=3751] ppid=3746 vsize=115744 CPUtime=558.05 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 19626 0 0 0 55797 8 0 0 25 0 1 0 517687215 118521856 19499 33554432000 4194304 4331988 140737041259200 18446744073709551615 4211445 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 28936 19499 173 34 0 27378 0
Current children cumulated CPU time (s) 4483.03
Current children cumulated vsize (KiB) 1496396

[startup+1182.3 s]
/proc/loadavg: 10.15 10.12 9.99 11/188 3881
/proc/meminfo: memFree=17958028/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=870744 CPUtime=1182.32 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 212584 0 0 0 118160 72 0 0 25 0 1 0 517687215 891641856 27437 33554432000 4194304 4587354 140733328132496 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 217686 27437 337 96 0 214248 0
[pid=3748] ppid=3746 vsize=50400 CPUtime=1182.32 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 9438 0 0 0 118231 1 0 0 25 0 1 0 517687215 51609600 9324 33554432000 4194304 4785740 140735469266192 18446744073709551615 4287013 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 12600 9324 341 145 0 9645 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=587.96 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 58796 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=36800 CPUtime=1182.17 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 88735 0 0 0 118206 11 0 0 25 0 1 0 517687215 37683200 8382 33554432000 4194304 4352236 140733425946192 18446744073709551615 4231284 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 9200 8382 127 39 0 8280 0
[pid=3751] ppid=3746 vsize=115744 CPUtime=587.91 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 20637 0 0 0 58783 8 0 0 25 0 1 0 517687215 118521856 20510 33554432000 4194304 4331988 140737041259200 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 28936 20510 173 34 0 27378 0
Current children cumulated CPU time (s) 4722.68
Current children cumulated vsize (KiB) 1547972



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.11 10.11 9.99 11/188 3881
/proc/meminfo: memFree=17962604/32951124 swapFree=67111528/67111528
[pid=3746] ppid=3744 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/3746/stat : 3746 (ppfolio) S 3744 3746 2759 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 517687215 18763776 390 33554432000 4194304 4287625 140734382191968 18446744073709551615 230809185807 0 0 4096 65536 17392181035327815679 0 0 17 4 0 0 0
/proc/3746/statm: 4581 390 341 23 0 91 0
[pid=3747] ppid=3746 vsize=806520 CPUtime=1201.73 cores=0
/proc/3747/stat : 3747 (cryptominisat) R 3746 3746 2759 0 -1 4202496 213005 0 0 0 120100 73 0 0 25 0 1 0 517687215 825876480 23445 33554432000 4194304 4587354 140733328132496 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3747/statm: 201630 23445 337 96 0 198192 0
[pid=3748] ppid=3746 vsize=50568 CPUtime=1201.72 cores=4
/proc/3748/stat : 3748 (clasp) R 3746 3746 2759 0 -1 4202496 9486 0 0 0 120171 1 0 0 25 0 1 0 517687215 51781632 9372 33554432000 4194304 4785740 140735469266192 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/3748/statm: 12642 9372 341 145 0 9687 0
[pid=3749] ppid=3746 vsize=455960 CPUtime=597.65 cores=6
/proc/3749/stat : 3749 (TNM) R 3746 3746 2759 0 -1 4202496 366 0 0 0 59765 0 0 0 25 0 1 0 517687215 466903040 262 33554432000 134512640 134534564 4288012672 18446744073709551615 134528497 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3749/statm: 113990 262 95 6 0 112656 0
[pid=3750] ppid=3746 vsize=31424 CPUtime=1201.57 cores=2
/proc/3750/stat : 3750 (lingeling) R 3746 3746 2759 0 -1 4202496 88735 0 0 0 120146 11 0 0 25 0 1 0 517687215 32178176 7038 33554432000 4194304 4352236 140733425946192 18446744073709551615 4276530 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/3750/statm: 7856 7038 127 39 0 6936 0
[pid=3751] ppid=3746 vsize=115744 CPUtime=597.51 cores=6
/proc/3751/stat : 3751 (march_hi) R 3746 3746 2759 0 -1 4202496 20963 0 0 0 59743 8 0 0 25 0 1 0 517687215 118521856 20836 33554432000 4194304 4331988 140737041259200 18446744073709551615 4315647 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/3751/statm: 28936 20836 173 34 0 27378 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 1478540

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3746 and gives
#  childrusage.ru_utime.tv_sec=2403
#  childrusage.ru_utime.tv_usec=184660
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=140978
# CPU time returned by wait4() is 2403.33
# while last known CPU time is 4800.18
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.18
CPU user time (s): 4799.25
CPU system time (s): 0.93
CPU usage (%): 399.445
Max. virtual memory (cumulated for all children) (KiB): 2238740

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2403.18
system time used= 0.140978
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 98761
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 413
involuntary context switches= 7988

runsolver used 1.92071 second user time and 4.64229 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-29 09:07:48
IDJOB=3191137
IDBENCH=82868
IDSOLVER=1612
FILE ID=node104/3191137-1304060868
RUNJOBID= node104-1304057377-2781
PBS_JOBID= 13170438
Free space on /tmp= 71540 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v650-c2769-S960948361-055.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191137-1304060868/watcher-3191137-1304060868 -o /tmp/evaluation-result-3191137-1304060868/solver-3191137-1304060868 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191137-1304060868.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b51753a48e6efd66554e7afe4efc3b19
RANDOM SEED=381171179

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18201108 kB
Buffers:       2197232 kB
Cached:       11818116 kB
SwapCached:          0 kB
Active:        2453760 kB
Inactive:     11709924 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18201108 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10140 kB
Writeback:          28 kB
AnonPages:      147936 kB
Mapped:          16840 kB
Slab:           523508 kB
PageTables:       4880 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   758520 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71528 MiB
End job on node104 at 2011-04-29 09:27:51