Trace number 3249719

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.31 1201.71

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-14x34.cnf
MD5SUM72677fc46303044d3d9e832fa24a37b2
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1904
Number of clauses207536
Sum of the clauses size824432
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22856
Number of clauses of size 30
Number of clauses of size 4204680
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3249719-1304084549/watcher-3249719-1304084549 -o /tmp/evaluation-result-3249719-1304084549/solver-3249719-1304084549 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3249719-1304084549.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.13 9.07 8.84 7/182 1691
/proc/meminfo: memFree=20406120/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18188 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) R 1689 1691 567 0 -1 4194304 372 0 0 0 0 0 0 0 25 0 1 0 598685563 18624512 310 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895176912 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/1691/statm: 4547 315 271 23 0 57 0

[startup+0.937037 s]
/proc/loadavg: 9.13 9.07 8.84 7/182 1691
/proc/meminfo: memFree=20406120/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.00103 s]
/proc/loadavg: 9.13 9.07 8.84 7/182 1691
/proc/meminfo: memFree=20406120/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.10101 s]
/proc/loadavg: 9.13 9.07 8.84 7/182 1691
/proc/meminfo: memFree=20406120/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.20099 s]
/proc/loadavg: 9.13 9.07 8.84 7/182 1691
/proc/meminfo: memFree=20406120/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50094 s]
/proc/loadavg: 9.13 9.07 8.84 7/182 1691
/proc/meminfo: memFree=20406120/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 17 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10663 s]
/proc/loadavg: 9.20 9.08 8.85 11/188 1697
/proc/meminfo: memFree=20278788/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 17 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=101008 CPUtime=3.09 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 17584 0 0 0 306 3 0 0 25 0 1 0 598685564 103432192 12780 33554432000 4194304 4587354 140736202900512 18446744073709551615 4357668 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 25252 12780 315 96 0 21814 0
[pid=1693] ppid=1691 vsize=37412 CPUtime=3.09 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 7665 0 0 0 309 0 0 0 25 0 1 0 598685564 38309888 6389 33554432000 4194304 4785740 140736941130320 18446744073709551615 4482824 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 9353 6389 316 145 0 6398 0
[pid=1694] ppid=1691 vsize=467968 CPUtime=1.97 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 5086 0 0 0 196 1 0 0 21 0 1 0 598685564 479199232 4982 33554432000 134512640 134534564 4288829056 18446744073709551615 134524591 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 116992 4982 91 6 0 115658 0
[pid=1695] ppid=1691 vsize=36788 CPUtime=3.1 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 8718 0 0 0 309 1 0 0 25 0 1 0 598685564 37670912 8356 33554432000 4194304 4352236 140734747465744 18446744073709551615 4267817 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 9197 8356 124 39 0 8277 0
[pid=1696] ppid=1691 vsize=35116 CPUtime=1.09 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 24011 0 0 0 106 3 0 0 25 0 1 0 598685564 35958784 5314 33554432000 4194304 4331988 140737391097344 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 8779 5314 150 34 0 7221 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 696616

[startup+6.30104 s]
/proc/loadavg: 9.27 9.10 8.85 11/188 1697
/proc/meminfo: memFree=20228864/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=122740 CPUtime=6.29 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 26916 0 0 0 625 4 0 0 25 0 1 0 598685564 125685760 20008 33554432000 4194304 4587354 140736202900512 18446744073709551615 4364706 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 30685 20008 337 96 0 27247 0
[pid=1693] ppid=1691 vsize=44804 CPUtime=6.29 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 9495 0 0 0 628 1 0 0 25 0 1 0 598685564 45879296 8219 33554432000 4194304 4785740 140736941130320 18446744073709551615 231895151301 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 11201 8219 316 145 0 8246 0
[pid=1694] ppid=1691 vsize=467968 CPUtime=3.56 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 5086 0 0 0 355 1 0 0 25 0 1 0 598685564 479199232 4982 33554432000 134512640 134534564 4288829056 18446744073709551615 134524491 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 116992 4982 91 6 0 115658 0
[pid=1695] ppid=1691 vsize=28828 CPUtime=6.29 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 9333 0 0 0 628 1 0 0 25 0 1 0 598685564 29519872 6369 33554432000 4194304 4352236 140734747465744 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 7207 6369 127 39 0 6287 0
[pid=1696] ppid=1691 vsize=35116 CPUtime=2.69 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 24011 0 0 0 266 3 0 0 25 0 1 0 598685564 35958784 5314 33554432000 4194304 4331988 140737391097344 18446744073709551615 4226625 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 8779 5314 150 34 0 7221 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 717780

[startup+12.7008 s]
/proc/loadavg: 9.41 9.13 8.86 11/188 1698
/proc/meminfo: memFree=20210788/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=116020 CPUtime=12.69 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 32811 0 0 0 1264 5 0 0 25 0 1 0 598685564 118804480 19332 33554432000 4194304 4587354 140736202900512 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 29005 19332 337 96 0 25567 0
[pid=1693] ppid=1691 vsize=47972 CPUtime=12.69 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 10280 0 0 0 1268 1 0 0 25 0 1 0 598685564 49123328 9004 33554432000 4194304 4785740 140736941130320 18446744073709551615 4495610 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 11993 9004 316 145 0 9038 0
[pid=1694] ppid=1691 vsize=467968 CPUtime=6.72 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 5086 0 0 0 671 1 0 0 25 0 1 0 598685564 479199232 4982 33554432000 134512640 134534564 4288829056 18446744073709551615 134524541 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 116992 4982 91 6 0 115658 0
[pid=1695] ppid=1691 vsize=28956 CPUtime=12.69 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 9749 0 0 0 1268 1 0 0 25 0 1 0 598685564 29650944 6401 33554432000 4194304 4352236 140734747465744 18446744073709551615 4276642 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 7239 6401 127 39 0 6319 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=5.9 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28308 0 0 0 586 4 0 0 25 0 1 0 598685564 55902208 7807 33554432000 4194304 4331988 140737391097344 18446744073709551615 4226471 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7807 169 34 0 12090 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 733832

[startup+25.5004 s]
/proc/loadavg: 9.50 9.16 8.88 11/188 1698
/proc/meminfo: memFree=20150636/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1624704 CPUtime=25.49 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 51971 0 0 0 2541 8 0 0 25 0 1 0 598685564 1663696896 26714 33554432000 4194304 4587354 140736202900512 18446744073709551615 4372590 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 406176 26716 337 96 0 402738 0
[pid=1693] ppid=1691 vsize=87748 CPUtime=25.48 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 20786 0 0 0 2544 4 0 0 25 0 1 0 598685564 89853952 19104 33554432000 4194304 4785740 140736941130320 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 21937 19104 340 145 0 18982 0
[pid=1694] ppid=1691 vsize=475368 CPUtime=13.11 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 7075 0 0 0 1310 1 0 0 25 0 1 0 598685564 486776832 6971 33554432000 134512640 134534564 4288829056 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 118842 6971 95 6 0 117508 0
[pid=1695] ppid=1691 vsize=29468 CPUtime=25.49 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 10261 0 0 0 2548 1 0 0 25 0 1 0 598685564 30175232 6529 33554432000 4194304 4352236 140734747465744 18446744073709551615 4328087 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 7367 6529 127 39 0 6447 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=12.23 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28313 0 0 0 1219 4 0 0 25 0 1 0 598685564 55902208 7812 33554432000 4194304 4331988 140737391097344 18446744073709551615 4263148 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 2290204

[startup+51.1007 s]
/proc/loadavg: 9.81 9.26 8.92 11/188 1699
/proc/meminfo: memFree=20090588/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1645160 CPUtime=51.09 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 93618 0 0 0 5095 14 0 0 25 0 1 0 598685564 1684643840 32057 33554432000 4194304 4587354 140736202900512 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 411290 32057 337 96 0 407852 0
[pid=1693] ppid=1691 vsize=108668 CPUtime=51.09 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 25780 0 0 0 5103 6 0 0 25 0 1 0 598685564 111276032 24098 33554432000 4194304 4785740 140736941130320 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 27167 24098 340 145 0 24212 0
[pid=1694] ppid=1691 vsize=475368 CPUtime=25.81 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 7075 0 0 0 2580 1 0 0 25 0 1 0 598685564 486776832 6971 33554432000 134512640 134534564 4288829056 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 118842 6971 95 6 0 117508 0
[pid=1695] ppid=1691 vsize=31264 CPUtime=51.09 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 11734 0 0 0 5108 1 0 0 25 0 1 0 598685564 32014336 6978 33554432000 4194304 4352236 140734747465744 18446744073709551615 4328109 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 7816 6978 127 39 0 6896 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=25 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28313 0 0 0 2496 4 0 0 25 0 1 0 598685564 55902208 7812 33554432000 4194304 4331988 140737391097344 18446744073709551615 4263203 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 2333376

[startup+102.301 s]
/proc/loadavg: 10.04 9.41 8.99 11/188 1700
/proc/meminfo: memFree=20072584/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1662216 CPUtime=102.29 cores=1

################
# More data... #
################

/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 3524.42
Current children cumulated vsize (KiB) 2515840

[startup+942.301 s]
/proc/loadavg: 9.23 9.52 9.39 10/187 1979
/proc/meminfo: memFree=20051152/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1717016 CPUtime=942.31 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 906443 0 0 0 94001 230 0 0 25 0 1 0 598685564 1758224384 55997 33554432000 4194304 4587354 140736202900512 18446744073709551615 4238600 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 429254 55997 337 96 0 425816 0
[pid=1693] ppid=1691 vsize=251364 CPUtime=942.31 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 58536 0 0 0 94217 14 0 0 25 0 1 0 598685564 257396736 56854 33554432000 4194304 4785740 140736941130320 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 62841 56854 340 145 0 59886 0
[pid=1694] ppid=1691 vsize=475368 CPUtime=469.02 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 7075 0 0 0 46901 1 0 0 25 0 1 0 598685564 486776832 6971 33554432000 134512640 134534564 4288829056 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 118842 6971 95 6 0 117508 0
[pid=1695] ppid=1691 vsize=40360 CPUtime=942.32 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 42648 0 0 0 94226 6 0 0 25 0 1 0 598685564 41328640 9252 33554432000 4194304 4352236 140734747465744 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 10090 9252 127 39 0 9170 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=468.13 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28313 0 0 0 46809 4 0 0 25 0 1 0 598685564 55902208 7812 33554432000 4194304 4331988 140737391097344 18446744073709551615 4228335 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 3764.09
Current children cumulated vsize (KiB) 2557024

[startup+1002.3 s]
/proc/loadavg: 9.20 9.45 9.37 10/187 1981
/proc/meminfo: memFree=20065628/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1718032 CPUtime=1002.31 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 955943 0 0 0 99985 246 0 0 25 0 1 0 598685564 1759264768 50678 33554432000 4194304 4587354 140736202900512 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 429508 50678 337 96 0 426070 0
[pid=1693] ppid=1691 vsize=254840 CPUtime=1002.32 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 59445 0 0 0 100217 15 0 0 25 0 1 0 598685564 260956160 57763 33554432000 4194304 4785740 140736941130320 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 63710 57763 340 145 0 60755 0
[pid=1694] ppid=1691 vsize=475368 CPUtime=498.84 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 7075 0 0 0 49883 1 0 0 25 0 1 0 598685564 486776832 6971 33554432000 134512640 134534564 4288829056 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 118842 6971 95 6 0 117508 0
[pid=1695] ppid=1691 vsize=40360 CPUtime=1002.32 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 45080 0 0 0 100225 7 0 0 25 0 1 0 598685564 41328640 9252 33554432000 4194304 4352236 140734747465744 18446744073709551615 4234513 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 10090 9252 127 39 0 9170 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=497.98 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28313 0 0 0 49794 4 0 0 25 0 1 0 598685564 55902208 7812 33554432000 4194304 4331988 140737391097344 18446744073709551615 4263230 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 4003.77
Current children cumulated vsize (KiB) 2561516

[startup+1062.3 s]
/proc/loadavg: 9.18 9.40 9.36 10/187 1983
/proc/meminfo: memFree=20022204/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1716940 CPUtime=1062.32 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 996585 0 0 0 105970 262 0 0 25 0 1 0 598685564 1758146560 50678 33554432000 4194304 4587354 140736202900512 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 429235 50678 337 96 0 425797 0
[pid=1693] ppid=1691 vsize=257900 CPUtime=1062.33 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 60086 0 0 0 106218 15 0 0 25 0 1 0 598685564 264089600 58404 33554432000 4194304 4785740 140736941130320 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 64475 58404 340 145 0 61520 0
[pid=1694] ppid=1691 vsize=475368 CPUtime=528.68 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 7075 0 0 0 52867 1 0 0 25 0 1 0 598685564 486776832 6971 33554432000 134512640 134534564 4288829056 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 118842 6971 95 6 0 117508 0
[pid=1695] ppid=1691 vsize=45224 CPUtime=1062.32 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 47512 0 0 0 106225 7 0 0 25 0 1 0 598685564 46309376 10468 33554432000 4194304 4352236 140734747465744 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 11306 10468 127 39 0 10386 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=527.82 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28313 0 0 0 52778 4 0 0 25 0 1 0 598685564 55902208 7812 33554432000 4194304 4331988 140737391097344 18446744073709551615 4263258 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 4243.47
Current children cumulated vsize (KiB) 2568348

[startup+1122.3 s]
/proc/loadavg: 9.20 9.37 9.35 10/188 1985
/proc/meminfo: memFree=19945764/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1759884 CPUtime=1122.31 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 1047273 0 0 0 111954 277 0 0 25 0 1 0 598685564 1802121216 65380 33554432000 4194304 4587354 140736202900512 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 439971 65380 337 96 0 436533 0
[pid=1693] ppid=1691 vsize=267384 CPUtime=1122.32 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 62168 0 0 0 112217 15 0 0 25 0 1 0 598685564 273801216 60486 33554432000 4194304 4785740 140736941130320 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 66846 60486 340 145 0 63891 0
[pid=1694] ppid=1691 vsize=475368 CPUtime=558.53 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 7075 0 0 0 55852 1 0 0 25 0 1 0 598685564 486776832 6971 33554432000 134512640 134534564 4288829056 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 118842 6971 95 6 0 117508 0
[pid=1695] ppid=1691 vsize=44968 CPUtime=1122.33 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 49880 0 0 0 112225 8 0 0 25 0 1 0 598685564 46047232 10404 33554432000 4194304 4352236 140734747465744 18446744073709551615 4276518 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 11242 10404 127 39 0 10322 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=557.64 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28313 0 0 0 55760 4 0 0 25 0 1 0 598685564 55902208 7812 33554432000 4194304 4331988 140737391097344 18446744073709551615 4299872 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 2620520

[startup+1182.31 s]
/proc/loadavg: 9.16 9.33 9.34 10/187 1995
/proc/meminfo: memFree=19985156/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1717804 CPUtime=1182.32 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 1086777 0 0 0 117938 294 0 0 25 0 1 0 598685564 1759031296 50678 33554432000 4194304 4587354 140736202900512 18446744073709551615 4243888 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 429451 50678 337 96 0 426013 0
[pid=1693] ppid=1691 vsize=274772 CPUtime=1182.33 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 63793 0 0 0 118218 15 0 0 25 0 1 0 598685564 281366528 62111 33554432000 4194304 4785740 140736941130320 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 68693 62111 340 145 0 65738 0
[pid=1694] ppid=1691 vsize=475368 CPUtime=588.33 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 7075 0 0 0 58832 1 0 0 25 0 1 0 598685564 486776832 6971 33554432000 134512640 134534564 4288829056 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 118842 6971 95 6 0 117508 0
[pid=1695] ppid=1691 vsize=40360 CPUtime=1182.33 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 51128 0 0 0 118225 8 0 0 25 0 1 0 598685564 41328640 9252 33554432000 4194304 4352236 140734747465744 18446744073709551615 4276530 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 10090 9252 127 39 0 9170 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=587.51 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28313 0 0 0 58747 4 0 0 25 0 1 0 598685564 55902208 7812 33554432000 4194304 4331988 140737391097344 18446744073709551615 4263258 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 4722.82
Current children cumulated vsize (KiB) 2581220



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 9.25 9.34 9.34 10/187 1995
/proc/meminfo: memFree=19926372/32950928 swapFree=67111524/67111528
[pid=1691] ppid=1689 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1691/stat : 1691 (ppfolio) S 1689 1691 567 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 598685563 18763776 390 33554432000 4194304 4287625 140737086473376 18446744073709551615 231895510543 0 0 4096 65536 4537553375364907007 0 0 17 1 0 0 0
/proc/1691/statm: 4581 390 341 23 0 91 0
[pid=1692] ppid=1691 vsize=1865500 CPUtime=1201.72 cores=1
/proc/1692/stat : 1692 (cryptominisat) R 1691 1691 567 0 -1 4202496 1107151 0 0 0 119872 300 0 0 25 0 1 0 598685564 1910272000 64101 33554432000 4194304 4587354 140736202900512 18446744073709551615 4238683 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1692/statm: 466375 64101 337 96 0 462937 0
[pid=1693] ppid=1691 vsize=275836 CPUtime=1201.72 cores=5
/proc/1693/stat : 1693 (clasp) R 1691 1691 567 0 -1 4202496 64004 0 0 0 120157 15 0 0 25 0 1 0 598685564 282456064 62322 33554432000 4194304 4785740 140736941130320 18446744073709551615 4562722 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1693/statm: 68959 62322 340 145 0 66004 0
[pid=1694] ppid=1691 vsize=475368 CPUtime=598.02 cores=7
/proc/1694/stat : 1694 (TNM) R 1691 1691 567 0 -1 4202496 7075 0 0 0 59801 1 0 0 25 0 1 0 598685564 486776832 6971 33554432000 134512640 134534564 4288829056 18446744073709551615 134529632 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1694/statm: 118842 6971 95 6 0 117508 0
[pid=1695] ppid=1691 vsize=40872 CPUtime=1201.73 cores=3
/proc/1695/stat : 1695 (lingeling) R 1691 1691 567 0 -1 4202496 51256 0 0 0 120165 8 0 0 25 0 1 0 598685564 41852928 9380 33554432000 4194304 4352236 140734747465744 18446744073709551615 4328336 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1695/statm: 10218 9380 127 39 0 9298 0
[pid=1696] ppid=1691 vsize=54592 CPUtime=597.12 cores=7
/proc/1696/stat : 1696 (march_hi) R 1691 1691 567 0 -1 4202496 28313 0 0 0 59708 4 0 0 25 0 1 0 598685564 55902208 7812 33554432000 4194304 4331988 140737391097344 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1696/statm: 13648 7812 173 34 0 12090 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 2730492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1691 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=6998
# CPU time returned by wait4() is 0.008997
# while last known CPU time is 4800.31
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.31
CPU user time (s): 4797.03
CPU system time (s): 3.28
CPU usage (%): 399.456
Max. virtual memory (cumulated for all children) (KiB): 4222408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.006998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 523
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 333
involuntary context switches= 6

runsolver used 1.85472 second user time and 4.70328 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 15:42:29
IDJOB=3249719
IDBENCH=83182
IDSOLVER=1612
FILE ID=node114/3249719-1304084549
RUNJOBID= node114-1304077601-586
PBS_JOBID= 13170509
Free space on /tmp= 71788 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-14x34.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3249719-1304084549/watcher-3249719-1304084549 -o /tmp/evaluation-result-3249719-1304084549/solver-3249719-1304084549 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3249719-1304084549.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 72677fc46303044d3d9e832fa24a37b2
RANDOM SEED=1214132395

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20406276 kB
Buffers:       2222952 kB
Cached:        9355208 kB
SwapCached:          4 kB
Active:        3167012 kB
Inactive:      8796932 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20406276 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           14740 kB
Writeback:           0 kB
AnonPages:      385312 kB
Mapped:          16712 kB
Slab:           516468 kB
PageTables:       5704 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  2763652 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71780 MiB
End job on node114 at 2011-04-29 16:02:33