Trace number 3258477

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.36 1201.71

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2400c266431gyes6.cnf
MD5SUMe23fefb786281285c1d045e8bc698d74
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3258477-1304034014/watcher-3258477-1304034014 -o /tmp/evaluation-result-3258477-1304034014/solver-3258477-1304034014 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3258477-1304034014.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.18 10.09 9.25 9/182 11536
/proc/meminfo: memFree=15131244/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) R 11534 11536 10991 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0

[startup+0.220566 s]
/proc/loadavg: 10.18 10.09 9.25 9/182 11536
/proc/meminfo: memFree=15131244/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) R 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300556 s]
/proc/loadavg: 10.18 10.09 9.25 9/182 11536
/proc/meminfo: memFree=15131244/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 24 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.400537 s]
/proc/loadavg: 10.18 10.09 9.25 9/182 11536
/proc/meminfo: memFree=15131244/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 24 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700477 s]
/proc/loadavg: 10.18 10.09 9.25 9/182 11536
/proc/meminfo: memFree=15131244/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 21 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50032 s]
/proc/loadavg: 10.18 10.09 9.25 13/188 11542
/proc/meminfo: memFree=15014752/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=66580 CPUtime=1.48 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 17359 0 0 0 146 2 0 0 25 0 1 0 495817052 68177920 11471 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238043 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 16645 11471 326 96 0 13207 0
[pid=11538] ppid=11536 vsize=32288 CPUtime=1.48 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 6531 0 0 0 148 0 0 0 25 0 1 0 495817052 33062912 5251 33554432000 4194304 4785740 140735568543008 18446744073709551615 4287741 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 8072 5251 318 145 0 5117 0
[pid=11539] ppid=11536 vsize=464404 CPUtime=0.77 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 4422 0 0 0 77 0 0 0 25 0 1 0 495817052 475549696 4319 33554432000 134512640 134534564 4290171104 18446744073709551615 134524695 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 116101 4319 91 6 0 114767 0
[pid=11540] ppid=11536 vsize=16664 CPUtime=1.48 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 4161 0 0 0 148 0 0 0 25 0 1 0 495817052 17063936 3033 33554432000 4194304 4352236 140734418140416 18446744073709551615 4268468 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 4166 3033 124 39 0 3246 0
[pid=11541] ppid=11536 vsize=41880 CPUtime=0.69 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 17822 0 0 0 67 2 0 0 25 0 1 0 495817052 42885120 4436 33554432000 4194304 4331988 140735022014448 18446744073709551615 264726060955 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 10470 4436 160 34 0 8912 0
Current children cumulated CPU time (s) 5.9
Current children cumulated vsize (KiB) 640140

[startup+3.10102 s]
/proc/loadavg: 10.25 10.11 9.26 11/188 11542
/proc/meminfo: memFree=14989648/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=239624 CPUtime=3.09 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 19358 0 0 0 306 3 0 0 25 0 1 0 495817052 245374976 11805 33554432000 4194304 4587354 140735352294240 18446744073709551615 4239240 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 59906 11805 331 96 0 56468 0
[pid=11538] ppid=11536 vsize=30016 CPUtime=3.08 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 6595 0 0 0 308 0 0 0 25 0 1 0 495817052 30736384 4794 33554432000 4194304 4785740 140735568543008 18446744073709551615 4287129 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 7504 4794 340 145 0 4549 0
[pid=11539] ppid=11536 vsize=466384 CPUtime=1.57 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6322 0 0 0 157 0 0 0 25 0 1 0 495817052 477577216 6219 33554432000 134512640 134534564 4290171104 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 116596 6219 95 6 0 115262 0
[pid=11540] ppid=11536 vsize=20972 CPUtime=3.08 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 5533 0 0 0 308 0 0 0 25 0 1 0 495817052 21475328 4405 33554432000 4194304 4352236 140734418140416 18446744073709551615 4241442 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 5243 4405 127 39 0 4323 0
[pid=11541] ppid=11536 vsize=42816 CPUtime=1.49 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 20076 0 0 0 147 2 0 0 25 0 1 0 495817052 43843584 4698 33554432000 4194304 4331988 140735022014448 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 10704 4698 175 34 0 9146 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 818136

[startup+6.30042 s]
/proc/loadavg: 10.25 10.11 9.26 11/188 11542
/proc/meminfo: memFree=14959392/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=250208 CPUtime=6.29 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 21591 0 0 0 626 3 0 0 25 0 1 0 495817052 256212992 14036 33554432000 4194304 4587354 140735352294240 18446744073709551615 4365258 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 62552 14036 337 96 0 59114 0
[pid=11538] ppid=11536 vsize=38684 CPUtime=6.28 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 8802 0 0 0 627 1 0 0 25 0 1 0 495817052 39612416 7001 33554432000 4194304 4785740 140735568543008 18446744073709551615 4552626 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 9671 7001 340 145 0 6716 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=3.15 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 315 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=26348 CPUtime=6.28 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 6366 0 0 0 628 0 0 0 25 0 1 0 495817052 26980352 5238 33554432000 4194304 4352236 140734418140416 18446744073709551615 4328159 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 6587 5238 127 39 0 5667 0
[pid=11541] ppid=11536 vsize=43476 CPUtime=3.09 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 20251 0 0 0 307 2 0 0 25 0 1 0 495817052 44519424 4873 33554432000 4194304 4331988 140735022014448 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 10869 4873 175 34 0 9311 0
Current children cumulated CPU time (s) 25.09
Current children cumulated vsize (KiB) 847256

[startup+12.7882 s]
/proc/loadavg: 10.23 10.10 9.26 11/188 11542
/proc/meminfo: memFree=14897880/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=269436 CPUtime=12.78 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 26504 0 0 0 1274 4 0 0 25 0 1 0 495817052 275902464 18946 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 67359 18946 337 96 0 63921 0
[pid=11538] ppid=11536 vsize=54196 CPUtime=12.77 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 12688 0 0 0 1274 3 0 0 25 0 1 0 495817052 55496704 10887 33554432000 4194304 4785740 140735568543008 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 13549 10887 340 145 0 10594 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=6.4 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 640 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=28880 CPUtime=12.77 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 6999 0 0 0 1277 0 0 0 25 0 1 0 495817052 29573120 5871 33554432000 4194304 4352236 140734418140416 18446744073709551615 4328336 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 7220 5871 127 39 0 6300 0
[pid=11541] ppid=11536 vsize=43756 CPUtime=6.3 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 20324 0 0 0 628 2 0 0 25 0 1 0 495817052 44806144 4946 33554432000 4194304 4331988 140735022014448 18446744073709551615 4226496 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 10939 4946 175 34 0 9381 0
Current children cumulated CPU time (s) 51.02
Current children cumulated vsize (KiB) 884808

[startup+25.5008 s]
/proc/loadavg: 9.91 10.03 9.25 11/188 11574
/proc/meminfo: memFree=14768456/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=258744 CPUtime=25.49 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 31683 0 0 0 2543 6 0 0 25 0 1 0 495817052 264953856 21497 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238595 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 64686 21497 337 96 0 61248 0
[pid=11538] ppid=11536 vsize=78176 CPUtime=25.47 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 18565 0 0 0 2541 6 0 0 25 0 1 0 495817052 80052224 16764 33554432000 4194304 4785740 140735568543008 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 19544 16764 340 145 0 16589 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=12.7 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 1270 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134528991 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=35360 CPUtime=25.49 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 8619 0 0 0 2548 1 0 0 25 0 1 0 495817052 36208640 7491 33554432000 4194304 4352236 140734418140416 18446744073709551615 4209104 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 8840 7491 127 39 0 7920 0
[pid=11541] ppid=11536 vsize=44316 CPUtime=12.64 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 20446 0 0 0 1262 2 0 0 25 0 1 0 495817052 45379584 5068 33554432000 4194304 4331988 140735022014448 18446744073709551615 4226496 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 11079 5068 175 34 0 9521 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 905136

[startup+51.101 s]
/proc/loadavg: 10.02 10.05 9.28 11/188 11575
/proc/meminfo: memFree=14672024/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=251536 CPUtime=51.09 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 48137 0 0 0 5100 9 0 0 25 0 1 0 495817052 257572864 24024 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238591 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 62884 24024 337 96 0 59446 0
[pid=11538] ppid=11536 vsize=81068 CPUtime=51.08 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 19243 0 0 0 5101 7 0 0 25 0 1 0 495817052 83013632 17442 33554432000 4194304 4785740 140735568543008 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 20267 17442 340 145 0 17312 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=25.41 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 2541 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=36904 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/11541/statm: 17984 10196 175 34 0 16426 0
Current children cumulated CPU time (s) 3524.44
Current children cumulated vsize (KiB) 1159904

[startup+942.301 s]
/proc/loadavg: 10.12 10.15 9.81 11/188 11599
/proc/meminfo: memFree=14160208/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=337936 CPUtime=942.32 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 258261 0 0 0 94114 118 0 0 25 0 1 0 495817052 346046464 37411 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238600 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 84484 37411 337 96 0 81046 0
[pid=11538] ppid=11536 vsize=204452 CPUtime=942.31 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 48898 0 0 0 94211 20 0 0 25 0 1 0 495817052 209358848 47097 33554432000 4194304 4785740 140735568543008 18446744073709551615 264726102642 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 51113 47097 340 145 0 48158 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=468.65 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 46865 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=76852 CPUtime=942.32 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 111151 0 0 0 94219 13 0 0 25 0 1 0 495817052 78696448 18375 33554432000 4194304 4352236 140734418140416 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 19213 18375 127 39 0 18293 0
[pid=11541] ppid=11536 vsize=71936 CPUtime=468.52 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 25831 0 0 0 46846 6 0 0 25 0 1 0 495817052 73662464 10451 33554432000 4194304 4331988 140735022014448 18446744073709551615 4228224 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 17984 10451 175 34 0 16426 0
Current children cumulated CPU time (s) 3764.12
Current children cumulated vsize (KiB) 1179716

[startup+1002.3 s]
/proc/loadavg: 10.14 10.15 9.83 11/188 11600
/proc/meminfo: memFree=14107232/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=364768 CPUtime=1002.33 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 288659 0 0 0 100104 129 0 0 25 0 1 0 495817052 373522432 47970 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238582 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 91192 47970 337 96 0 87754 0
[pid=11538] ppid=11536 vsize=206792 CPUtime=1002.31 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 49432 0 0 0 100211 20 0 0 25 0 1 0 495817052 211755008 47631 33554432000 4194304 4785740 140735568543008 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 51698 47631 340 145 0 48743 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=498.52 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 49852 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=76852 CPUtime=1002.33 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 120367 0 0 0 100219 14 0 0 25 0 1 0 495817052 78696448 18375 33554432000 4194304 4352236 140734418140416 18446744073709551615 4328589 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 19213 18375 127 39 0 18293 0
[pid=11541] ppid=11536 vsize=71936 CPUtime=498.32 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 26089 0 0 0 49826 6 0 0 25 0 1 0 495817052 73662464 10709 33554432000 4194304 4331988 140735022014448 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 17984 10709 175 34 0 16426 0
Current children cumulated CPU time (s) 4003.81
Current children cumulated vsize (KiB) 1208888

[startup+1062.3 s]
/proc/loadavg: 10.23 10.17 9.85 11/188 11602
/proc/meminfo: memFree=14105836/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=359484 CPUtime=1062.33 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 304475 0 0 0 106096 137 0 0 25 0 1 0 495817052 368111616 44959 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238778 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 89871 44959 337 96 0 86433 0
[pid=11538] ppid=11536 vsize=211520 CPUtime=1062.32 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 50531 0 0 0 106211 21 0 0 25 0 1 0 495817052 216596480 48730 33554432000 4194304 4785740 140735568543008 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 52880 48730 340 145 0 49925 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=528.32 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 52832 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=78904 CPUtime=1062.33 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 131632 0 0 0 106218 15 0 0 25 0 1 0 495817052 80797696 18888 33554432000 4194304 4352236 140734418140416 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 19726 18888 127 39 0 18806 0
[pid=11541] ppid=11536 vsize=71936 CPUtime=528.2 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 26317 0 0 0 52814 6 0 0 25 0 1 0 495817052 73662464 10937 33554432000 4194304 4331988 140735022014448 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 17984 10937 175 34 0 16426 0
Current children cumulated CPU time (s) 4243.5
Current children cumulated vsize (KiB) 1210384

[startup+1122.3 s]
/proc/loadavg: 10.29 10.18 9.87 11/188 11604
/proc/meminfo: memFree=14078280/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=378316 CPUtime=1122.33 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 320892 0 0 0 112086 147 0 0 25 0 1 0 495817052 387395584 46647 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238392 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 94579 46647 337 96 0 91141 0
[pid=11538] ppid=11536 vsize=212232 CPUtime=1122.32 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 50707 0 0 0 112211 21 0 0 25 0 1 0 495817052 217325568 48906 33554432000 4194304 4785740 140735568543008 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 53058 48906 340 145 0 50103 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=558.19 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 55819 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=78904 CPUtime=1122.33 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 138800 0 0 0 112217 16 0 0 25 0 1 0 495817052 80797696 18888 33554432000 4194304 4352236 140734418140416 18446744073709551615 4328126 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 19726 18888 127 39 0 18806 0
[pid=11541] ppid=11536 vsize=77756 CPUtime=558 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 26524 0 0 0 55794 6 0 0 25 0 1 0 495817052 79622144 11144 33554432000 4194304 4331988 140735022014448 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 19439 11144 175 34 0 17881 0
Current children cumulated CPU time (s) 4483.17
Current children cumulated vsize (KiB) 1235748

[startup+1182.31 s]
/proc/loadavg: 10.17 10.16 9.88 11/188 11605
/proc/meminfo: memFree=14066592/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=336616 CPUtime=1182.34 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 337643 0 0 0 118077 157 0 0 25 0 1 0 495817052 344694784 48325 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 84154 48325 337 96 0 80716 0
[pid=11538] ppid=11536 vsize=214392 CPUtime=1182.33 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 51175 0 0 0 118212 21 0 0 25 0 1 0 495817052 219537408 49374 33554432000 4194304 4785740 140735568543008 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 53598 49374 340 145 0 50643 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=588.01 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 58801 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=93240 CPUtime=1182.33 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 149552 0 0 0 118216 17 0 0 25 0 1 0 495817052 95477760 22472 33554432000 4194304 4352236 140734418140416 18446744073709551615 4329060 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 23310 22472 127 39 0 22390 0
[pid=11541] ppid=11536 vsize=77756 CPUtime=587.87 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 26750 0 0 0 58780 7 0 0 25 0 1 0 495817052 79622144 11370 33554432000 4194304 4331988 140735022014448 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 19439 11370 175 34 0 17881 0
Current children cumulated CPU time (s) 4722.88
Current children cumulated vsize (KiB) 1210544



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.12 10.15 9.89 11/188 11606
/proc/meminfo: memFree=14062372/32951124 swapFree=67111528/67111528
[pid=11536] ppid=11534 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11536/stat : 11536 (ppfolio) S 11534 11536 10991 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 495817052 18763776 390 33554432000 4194304 4287625 140734243612976 18446744073709551615 264726425103 0 0 4096 65536 4594454613930803199 0 0 17 5 0 0 0
/proc/11536/statm: 4581 390 341 23 0 91 0
[pid=11537] ppid=11536 vsize=326592 CPUtime=1201.73 cores=1
/proc/11537/stat : 11537 (cryptominisat) R 11536 11536 10991 0 -1 4202496 343121 0 0 0 120012 161 0 0 25 0 1 0 495817052 334430208 48663 33554432000 4194304 4587354 140735352294240 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11537/statm: 81648 48663 337 96 0 78210 0
[pid=11538] ppid=11536 vsize=214960 CPUtime=1201.73 cores=5
/proc/11538/stat : 11538 (clasp) R 11536 11536 10991 0 -1 4202496 51347 0 0 0 120152 21 0 0 25 0 1 0 495817052 220119040 49546 33554432000 4194304 4785740 140735568543008 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11538/statm: 53740 49546 340 145 0 50785 0
[pid=11539] ppid=11536 vsize=470216 CPUtime=597.66 cores=7
/proc/11539/stat : 11539 (TNM) R 11536 11536 10991 0 -1 4202496 6323 0 0 0 59766 0 0 0 25 0 1 0 495817052 481501184 6220 33554432000 134512640 134534564 4290171104 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11539/statm: 117554 6220 95 6 0 116220 0
[pid=11540] ppid=11536 vsize=93240 CPUtime=1201.74 cores=3
/proc/11540/stat : 11540 (lingeling) R 11536 11536 10991 0 -1 4202496 153136 0 0 0 120156 18 0 0 25 0 1 0 495817052 95477760 22472 33554432000 4194304 4352236 140734418140416 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11540/statm: 23310 22472 127 39 0 22390 0
[pid=11541] ppid=11536 vsize=77756 CPUtime=597.5 cores=7
/proc/11541/stat : 11541 (march_hi) R 11536 11536 10991 0 -1 4202496 26816 0 0 0 59743 7 0 0 25 0 1 0 495817052 79622144 11436 33554432000 4194304 4331988 140735022014448 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11541/statm: 19439 11436 175 34 0 17881 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 1201088

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11536 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=2999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=5999
# CPU time returned by wait4() is 0.008998
# while last known CPU time is 4800.36
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.36
CPU user time (s): 4798.29
CPU system time (s): 2.07
CPU usage (%): 399.459
Max. virtual memory (cumulated for all children) (KiB): 1407432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.002999
system time used= 0.005999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 521
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 333
involuntary context switches= 6

runsolver used 1.84372 second user time and 4.71428 second system time

The end

Launcher Data 

Begin job on node141 at 2011-04-29 01:40:14
IDJOB=3258477
IDBENCH=71366
IDSOLVER=1612
FILE ID=node141/3258477-1304034014
RUNJOBID= node141-1304032810-11411
PBS_JOBID= 13170311
Free space on /tmp= 71412 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2400c266431gyes6.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3258477-1304034014/watcher-3258477-1304034014 -o /tmp/evaluation-result-3258477-1304034014/solver-3258477-1304034014 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3258477-1304034014.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e23fefb786281285c1d045e8bc698d74
RANDOM SEED=647684466

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15131524 kB
Buffers:       1622148 kB
Cached:       15523180 kB
SwapCached:          0 kB
Active:        7906420 kB
Inactive:      9330052 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15131524 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           24128 kB
Writeback:           0 kB
AnonPages:       90788 kB
Mapped:          16620 kB
Slab:           518828 kB
PageTables:       5072 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   696784 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71400 MiB
End job on node141 at 2011-04-29 02:00:18