Trace number 3288984

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.23 1201.71

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom20.cnf
MD5SUM9851f8e63efc4505343bf50c1cf30646
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables44362
Number of clauses148436
Sum of the clauses size378642
Maximum clause length1419
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 276003
Number of clauses of size 371663
Number of clauses of size 4209
Number of clauses of size 518
Number of clauses of size over 5542

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3288984-1304080189/watcher-3288984-1304080189 -o /tmp/evaluation-result-3288984-1304080189/solver-3288984-1304080189 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3288984-1304080189.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.14 8.25 8.48 7/181 3872
/proc/meminfo: memFree=27004268/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 519617461 18763776 390 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 4575833697319649279 0 0 17 3 0 0 0
/proc/3872/statm: 4581 390 341 23 0 91 0

[startup+0.126327 s]
/proc/loadavg: 8.14 8.25 8.48 7/181 3872
/proc/meminfo: memFree=27004268/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) R 3870 3872 3322 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 519617461 18763776 390 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/3872/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.20102 s]
/proc/loadavg: 8.14 8.25 8.48 7/181 3872
/proc/meminfo: memFree=27004268/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) R 3870 3872 3322 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 519617461 18763776 390 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/3872/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300988 s]
/proc/loadavg: 8.14 8.25 8.48 7/181 3872
/proc/meminfo: memFree=27004268/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 24 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195386380386304 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.700922 s]
/proc/loadavg: 8.14 8.25 8.48 7/181 3872
/proc/meminfo: memFree=27004268/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 24 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195386380386304 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+1.50079 s]
/proc/loadavg: 8.13 8.24 8.48 10/186 3878
/proc/meminfo: memFree=26881956/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=64100 CPUtime=1.49 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 13297 0 0 0 147 2 0 0 25 0 1 0 519617462 65638400 11066 33554432000 4194304 4587354 140734478186032 18446744073709551615 4229039 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 16025 11066 324 96 0 12587 0
[pid=3874] ppid=3872 vsize=38132 CPUtime=1.49 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 8697 0 0 0 148 1 0 0 25 0 1 0 519617462 39047168 6671 33554432000 4194304 4785740 140737402147616 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 9533 6671 340 145 0 6578 0
[pid=3876] ppid=3872 vsize=19932 CPUtime=1.48 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 5841 0 0 0 148 0 0 0 25 0 1 0 519617462 20410368 3961 33554432000 4194304 4352236 140737399594624 18446744073709551615 4215209 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 4983 3961 125 39 0 4063 0
[pid=3877] ppid=3872 vsize=98916 CPUtime=1.46 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 53207 0 0 0 139 7 0 0 25 0 1 0 519617462 101289984 11987 33554432000 4194304 4331988 140734213781264 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 24729 11987 181 34 0 23171 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 239404

[startup+3.10052 s]
/proc/loadavg: 8.13 8.24 8.48 10/186 3878
/proc/meminfo: memFree=26860156/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=64584 CPUtime=3.09 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 13961 0 0 0 307 2 0 0 25 0 1 0 519617462 66134016 11711 33554432000 4194304 4587354 140734478186032 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 16146 11711 330 96 0 12708 0
[pid=3874] ppid=3872 vsize=40272 CPUtime=3.09 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 9309 0 0 0 308 1 0 0 25 0 1 0 519617462 41238528 7283 33554432000 4194304 4785740 140737402147616 18446744073709551615 210204308165 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 10068 7283 340 145 0 7113 0
[pid=3876] ppid=3872 vsize=19932 CPUtime=3.08 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 5841 0 0 0 308 0 0 0 25 0 1 0 519617462 20410368 3961 33554432000 4194304 4352236 140737399594624 18446744073709551615 4267912 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 4983 3961 125 39 0 4063 0
[pid=3877] ppid=3872 vsize=106256 CPUtime=3.05 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 55146 0 0 0 298 7 0 0 25 0 1 0 519617462 108806144 13920 33554432000 4194304 4331988 140734213781264 18446744073709551615 4237136 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 26564 13920 175 34 0 25006 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 249368

[startup+6.30099 s]
/proc/loadavg: 8.13 8.24 8.48 10/186 3878
/proc/meminfo: memFree=26855120/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1460268 CPUtime=6.28 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 16157 0 0 0 626 2 0 0 25 0 1 0 519617462 1495314432 11356 33554432000 4194304 4587354 140734478186032 18446744073709551615 4241080 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 365067 11356 333 96 0 361629 0
[pid=3874] ppid=3872 vsize=45904 CPUtime=6.29 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 10728 0 0 0 627 2 0 0 25 0 1 0 519617462 47005696 8702 33554432000 4194304 4785740 140737402147616 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 11476 8702 340 145 0 8521 0
[pid=3876] ppid=3872 vsize=16236 CPUtime=6.28 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 6156 0 0 0 628 0 0 0 25 0 1 0 519617462 16625664 3227 33554432000 4194304 4352236 140737399594624 18446744073709551615 4328042 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 4059 3227 127 39 0 3139 0
[pid=3877] ppid=3872 vsize=108412 CPUtime=6.24 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 55765 0 0 0 616 8 0 0 25 0 1 0 519617462 111013888 14539 33554432000 4194304 4331988 140734213781264 18446744073709551615 4265477 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 27103 14539 175 34 0 25545 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 1649144

[startup+12.7009 s]
/proc/loadavg: 8.11 8.23 8.47 10/186 3878
/proc/meminfo: memFree=26832304/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195738567704576 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1461060 CPUtime=12.69 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 21210 0 0 0 1265 4 0 0 25 0 1 0 519617462 1496125440 13678 33554432000 4194304 4587354 140734478186032 18446744073709551615 4239308 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 365265 13678 336 96 0 361827 0
[pid=3874] ppid=3872 vsize=51016 CPUtime=12.69 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 11962 0 0 0 1267 2 0 0 25 0 1 0 519617462 52240384 9936 33554432000 4194304 4785740 140737402147616 18446744073709551615 4553051 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 12754 9936 340 145 0 9799 0
[pid=3876] ppid=3872 vsize=16232 CPUtime=12.68 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 6156 0 0 0 1268 0 0 0 25 0 1 0 519617462 16621568 3226 33554432000 4194304 4352236 140737399594624 18446744073709551615 4331604 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 4058 3226 127 39 0 3138 0
[pid=3877] ppid=3872 vsize=110476 CPUtime=12.61 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 56336 0 0 0 1253 8 0 0 25 0 1 0 519617462 113127424 15110 33554432000 4194304 4331988 140734213781264 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 27619 15110 175 34 0 26061 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 1657108

[startup+25.5008 s]
/proc/loadavg: 8.09 8.23 8.47 11/186 3879
/proc/meminfo: memFree=26804324/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1533400 CPUtime=25.49 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 27982 0 0 0 2544 5 0 0 25 0 1 0 519617462 1570201600 18050 33554432000 4194304 4587354 140734478186032 18446744073709551615 4244609 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 383350 18050 336 96 0 379912 0
[pid=3874] ppid=3872 vsize=61332 CPUtime=25.49 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 14531 0 0 0 2546 3 0 0 25 0 1 0 519617462 62803968 12505 33554432000 4194304 4785740 140737402147616 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 15333 12505 340 145 0 12378 0
[pid=3876] ppid=3872 vsize=17656 CPUtime=25.48 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 6512 0 0 0 2548 0 0 0 25 0 1 0 519617462 18079744 3582 33554432000 4194304 4352236 140737399594624 18446744073709551615 4328403 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 4414 3582 127 39 0 3494 0
[pid=3877] ppid=3872 vsize=111916 CPUtime=25.33 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 56676 0 0 0 2525 8 0 0 25 0 1 0 519617462 114601984 15450 33554432000 4194304 4331988 140734213781264 18446744073709551615 4299061 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 27979 15450 175 34 0 26421 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 1742628

[startup+51.1005 s]
/proc/loadavg: 8.18 8.24 8.46 10/186 3879
/proc/meminfo: memFree=26811308/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1439332 CPUtime=51.09 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 37913 0 0 0 5100 9 0 0 25 0 1 0 519617462 1473875968 13430 33554432000 4194304 4587354 140734478186032 18446744073709551615 4420266 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 359833 13430 336 96 0 356395 0
[pid=3874] ppid=3872 vsize=69068 CPUtime=51.09 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 16346 0 0 0 5105 4 0 0 25 0 1 0 519617462 70725632 14320 33554432000 4194304 4785740 140737402147616 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 17267 14320 340 145 0 14312 0
[pid=3876] ppid=3872 vsize=19728 CPUtime=51.08 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 7030 0 0 0 5108 0 0 0 25 0 1 0 519617462 20201472 4100 33554432000 4194304 4352236 140737399594624 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 4932 4100 127 39 0 4012 0
[pid=3877] ppid=3872 vsize=115032 CPUtime=50.79 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 56921 0 0 0 5071 8 0 0 25 0 1 0 519617462 117792768 15695 33554432000 4194304 4331988 140734213781264 18446744073709551615 4237130 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 28758 15695 175 34 0 27200 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 1661484

[startup+102.301 s]
/proc/loadavg: 8.21 8.23 8.44 10/186 3881
/proc/meminfo: memFree=26745680/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1459704 CPUtime=102.3 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 58558 0 0 0 10214 16 0 0 25 0 1 0 519617462 1494736896 18471 33554432000 4194304 4587354 140734478186032 18446744073709551615 4236364 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 364926 18471 336 96 0 361488 0
[pid=3874] ppid=3872 vsize=101232 CPUtime=102.29 cores=5

################
# More data... #
################


[startup+882.307 s]
/proc/loadavg: 8.17 8.11 8.23 9/186 3934
/proc/meminfo: memFree=26381448/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1484324 CPUtime=882.31 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 186127 0 0 0 88153 78 0 0 25 0 1 0 519617462 1519947776 24872 33554432000 4194304 4587354 140734478186032 18446744073709551615 210204344075 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 371081 24872 336 96 0 367643 0
[pid=3874] ppid=3872 vsize=205524 CPUtime=882.28 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 49717 0 0 0 88207 21 0 0 25 0 1 0 519617462 210456576 47691 33554432000 4194304 4785740 140737402147616 18446744073709551615 4287237 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 51381 47691 340 145 0 48426 0
[pid=3876] ppid=3872 vsize=41164 CPUtime=882.3 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 35686 0 0 0 88226 4 0 0 25 0 1 0 519617462 42151936 9459 33554432000 4194304 4352236 140737399594624 18446744073709551615 4329346 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 10291 9459 127 39 0 9371 0
[pid=3877] ppid=3872 vsize=130504 CPUtime=877.46 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 60275 0 0 0 87737 9 0 0 25 0 1 0 519617462 133636096 19049 33554432000 4194304 4331988 140734213781264 18446744073709551615 4287694 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 32626 19049 175 34 0 31068 0
Current children cumulated CPU time (s) 3524.36
Current children cumulated vsize (KiB) 1879840

[startup+942.301 s]
/proc/loadavg: 8.13 8.11 8.22 9/186 3936
/proc/meminfo: memFree=26372108/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1483836 CPUtime=942.3 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 199804 0 0 0 94146 84 0 0 25 0 1 0 519617462 1519448064 24246 33554432000 4194304 4587354 140734478186032 18446744073709551615 4238582 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 370959 24246 336 96 0 367521 0
[pid=3874] ppid=3872 vsize=205524 CPUtime=942.27 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 49744 0 0 0 94206 21 0 0 25 0 1 0 519617462 210456576 47718 33554432000 4194304 4785740 140737402147616 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 51381 47718 340 145 0 48426 0
[pid=3876] ppid=3872 vsize=41164 CPUtime=942.29 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 39270 0 0 0 94225 4 0 0 25 0 1 0 519617462 42151936 9459 33554432000 4194304 4352236 140737399594624 18446744073709551615 4328116 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 10291 9459 127 39 0 9371 0
[pid=3877] ppid=3872 vsize=130768 CPUtime=937.14 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 60412 0 0 0 93704 10 0 0 25 0 1 0 519617462 133906432 19186 33554432000 4194304 4331988 140734213781264 18446744073709551615 4226434 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 32692 19186 175 34 0 31134 0
Current children cumulated CPU time (s) 3764.01
Current children cumulated vsize (KiB) 1879616

[startup+1002.3 s]
/proc/loadavg: 8.05 8.08 8.20 9/186 3938
/proc/meminfo: memFree=26333984/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195738567704576 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1508372 CPUtime=1002.3 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 228368 0 0 0 100137 93 0 0 25 0 1 0 519617462 1544572928 31055 33554432000 4194304 4587354 140734478186032 18446744073709551615 4238477 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 377093 31055 336 96 0 373655 0
[pid=3874] ppid=3872 vsize=205524 CPUtime=1002.27 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 49752 0 0 0 100206 21 0 0 25 0 1 0 519617462 210456576 47726 33554432000 4194304 4785740 140737402147616 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 51381 47726 340 145 0 48426 0
[pid=3876] ppid=3872 vsize=46284 CPUtime=1002.29 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 42342 0 0 0 100224 5 0 0 25 0 1 0 519617462 47394816 10739 33554432000 4194304 4352236 140737399594624 18446744073709551615 4328429 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 11571 10739 127 39 0 10651 0
[pid=3877] ppid=3872 vsize=130900 CPUtime=996.81 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 60563 0 0 0 99671 10 0 0 25 0 1 0 519617462 134041600 19337 33554432000 4194304 4331988 140734213781264 18446744073709551615 4226400 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 32725 19337 175 34 0 31167 0
Current children cumulated CPU time (s) 4003.68
Current children cumulated vsize (KiB) 1909404

[startup+1062.3 s]
/proc/loadavg: 8.02 8.07 8.19 9/186 3939
/proc/meminfo: memFree=26341612/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1537192 CPUtime=1062.3 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 243313 0 0 0 106129 101 0 0 25 0 1 0 519617462 1574084608 28871 33554432000 4194304 4587354 140734478186032 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 384298 28871 336 96 0 380860 0
[pid=3874] ppid=3872 vsize=205704 CPUtime=1062.27 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 49771 0 0 0 106206 21 0 0 25 0 1 0 519617462 210640896 47745 33554432000 4194304 4785740 140737402147616 18446744073709551615 4553051 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 51426 47745 340 145 0 48471 0
[pid=3876] ppid=3872 vsize=46284 CPUtime=1062.29 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 45670 0 0 0 106224 5 0 0 25 0 1 0 519617462 47394816 10739 33554432000 4194304 4352236 140737399594624 18446744073709551615 4328075 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 11571 10739 127 39 0 10651 0
[pid=3877] ppid=3872 vsize=131164 CPUtime=1056.49 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 60699 0 0 0 105639 10 0 0 25 0 1 0 519617462 134311936 19473 33554432000 4194304 4331988 140734213781264 18446744073709551615 4297280 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 32791 19473 175 34 0 31233 0
Current children cumulated CPU time (s) 4243.36
Current children cumulated vsize (KiB) 1938668

[startup+1122.3 s]
/proc/loadavg: 8.00 8.05 8.17 9/186 3941
/proc/meminfo: memFree=26306100/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1491232 CPUtime=1122.3 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 255678 0 0 0 112124 106 0 0 25 0 1 0 519617462 1527021568 32851 33554432000 4194304 4587354 140734478186032 18446744073709551615 4238766 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 372808 32851 336 96 0 369370 0
[pid=3874] ppid=3872 vsize=206344 CPUtime=1122.27 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 49902 0 0 0 112206 21 0 0 25 0 1 0 519617462 211296256 47876 33554432000 4194304 4785740 140737402147616 18446744073709551615 4278544 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 51586 47876 340 145 0 48631 0
[pid=3876] ppid=3872 vsize=46284 CPUtime=1122.29 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 47206 0 0 0 112224 5 0 0 25 0 1 0 519617462 47394816 10739 33554432000 4194304 4352236 140737399594624 18446744073709551615 4328859 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 11571 10739 127 39 0 10651 0
[pid=3877] ppid=3872 vsize=131296 CPUtime=1116.16 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 60817 0 0 0 111606 10 0 0 25 0 1 0 519617462 134447104 19591 33554432000 4194304 4331988 140734213781264 18446744073709551615 4242538 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 32824 19591 175 34 0 31266 0
Current children cumulated CPU time (s) 4483.03
Current children cumulated vsize (KiB) 1893480

[startup+1182.3 s]
/proc/loadavg: 8.00 8.04 8.16 9/186 3942
/proc/meminfo: memFree=26337412/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1532872 CPUtime=1182.3 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 270900 0 0 0 118116 114 0 0 25 0 1 0 519617462 1569660928 30071 33554432000 4194304 4587354 140734478186032 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 383218 30071 336 96 0 379780 0
[pid=3874] ppid=3872 vsize=208088 CPUtime=1182.27 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 50336 0 0 0 118205 22 0 0 25 0 1 0 519617462 213082112 48310 33554432000 4194304 4785740 140737402147616 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 52022 48310 340 145 0 49067 0
[pid=3876] ppid=3872 vsize=49356 CPUtime=1182.3 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 48742 0 0 0 118224 6 0 0 25 0 1 0 519617462 50540544 11507 33554432000 4194304 4352236 140737399594624 18446744073709551615 4276812 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 12339 11507 127 39 0 11419 0
[pid=3877] ppid=3872 vsize=131428 CPUtime=1175.83 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 60930 0 0 0 117573 10 0 0 25 0 1 0 519617462 134582272 19704 33554432000 4194304 4331988 140734213781264 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 32857 19704 175 34 0 31299 0
Current children cumulated CPU time (s) 4722.71
Current children cumulated vsize (KiB) 1940068



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.00 8.04 8.16 9/186 3943
/proc/meminfo: memFree=26350280/32951124 swapFree=67088964/67111528
[pid=3872] ppid=3870 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/3872/stat : 3872 (ppfolio) S 3870 3872 3322 0 -1 4202496 524 1194 0 0 0 0 0 1 15 0 1 0 519617461 18763776 391 33554432000 4194304 4287625 140737487733008 18446744073709551615 210204667407 0 0 4096 65536 9224195742862639364 0 0 17 3 0 0 0
/proc/3872/statm: 4581 391 342 23 0 91 0
[pid=3873] ppid=3872 vsize=1592232 CPUtime=1201.7 cores=1
/proc/3873/stat : 3873 (cryptominisat) R 3872 3872 3322 0 -1 4202496 275736 0 0 0 120055 115 0 0 25 0 1 0 519617462 1630445568 26844 33554432000 4194304 4587354 140734478186032 18446744073709551615 4238491 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3873/statm: 398058 26844 336 96 0 394620 0
[pid=3874] ppid=3872 vsize=209168 CPUtime=1201.68 cores=5
/proc/3874/stat : 3874 (clasp) R 3872 3872 3322 0 -1 4202496 50533 0 0 0 120146 22 0 0 25 0 1 0 519617462 214188032 48507 33554432000 4194304 4785740 140737402147616 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3874/statm: 52292 48507 340 145 0 49337 0
[pid=3876] ppid=3872 vsize=38092 CPUtime=1201.71 cores=3
/proc/3876/stat : 3876 (lingeling) R 3872 3872 3322 0 -1 4202496 48742 0 0 0 120165 6 0 0 25 0 1 0 519617462 39006208 8691 33554432000 4194304 4352236 140737399594624 18446744073709551615 4329043 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3876/statm: 9523 8691 127 39 0 8603 0
[pid=3877] ppid=3872 vsize=131428 CPUtime=1195.13 cores=7
/proc/3877/stat : 3877 (march_hi) R 3872 3872 3322 0 -1 4202496 60972 0 0 0 119503 10 0 0 25 0 1 0 519617462 134582272 19746 33554432000 4194304 4331988 140734213781264 18446744073709551615 4265456 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3877/statm: 32857 19746 175 34 0 31299 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 1989244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3872 and gives
#  childrusage.ru_utime.tv_sec=1201
#  childrusage.ru_utime.tv_usec=655320
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=88986
# CPU time returned by wait4() is 1201.74
# while last known CPU time is 4800.23
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.23
CPU user time (s): 4798.69
CPU system time (s): 1.54
CPU usage (%): 399.449
Max. virtual memory (cumulated for all children) (KiB): 3408260

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1201.66
system time used= 0.088986
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 50461
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 292
involuntary context switches= 3320

runsolver used 1.86172 second user time and 4.70029 second system time

The end

Launcher Data 

Begin job on node130 at 2011-04-29 14:29:50
IDJOB=3288984
IDBENCH=83110
IDSOLVER=1612
FILE ID=node130/3288984-1304080189
RUNJOBID= node130-1304076955-3341
PBS_JOBID= 13170506
Free space on /tmp= 71984 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom20.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3288984-1304080189/watcher-3288984-1304080189 -o /tmp/evaluation-result-3288984-1304080189/solver-3288984-1304080189 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3288984-1304080189.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9851f8e63efc4505343bf50c1cf30646
RANDOM SEED=1711094621

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27004556 kB
Buffers:       1168808 kB
Cached:        4157736 kB
SwapCached:      22432 kB
Active:         605984 kB
Inactive:      4908540 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27004556 kB
SwapTotal:    67111528 kB
SwapFree:     67088964 kB
Dirty:           12828 kB
Writeback:           0 kB
AnonPages:      165188 kB
Mapped:          16444 kB
Slab:           369224 kB
PageTables:       5020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   789100 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71960 MiB
End job on node130 at 2011-04-29 14:49:53