Trace number 3191209

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.25 1201.61

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v600-c2556-S224791863-033.UNKNOWN.cnf
MD5SUM97219d7d3b8dcf40225a045ad28970d7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses2556
Sum of the clauses size7668
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32556
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191209-1304066367/watcher-3191209-1304066367 -o /tmp/evaluation-result-3191209-1304066367/solver-3191209-1304066367 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191209-1304066367.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.19 5.11 5.48 2/171 25395
/proc/meminfo: memFree=17463052/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) R 25393 25395 21582 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0

[startup+0.26894 s]
/proc/loadavg: 5.19 5.11 5.48 2/171 25395
/proc/meminfo: memFree=17463052/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300955 s]
/proc/loadavg: 5.19 5.11 5.48 2/171 25395
/proc/meminfo: memFree=17463052/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.400936 s]
/proc/loadavg: 5.19 5.11 5.48 2/171 25395
/proc/meminfo: memFree=17463052/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 24 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700807 s]
/proc/loadavg: 5.19 5.11 5.48 2/171 25395
/proc/meminfo: memFree=17463052/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 20 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50067 s]
/proc/loadavg: 5.19 5.11 5.48 6/177 25401
/proc/meminfo: memFree=17452464/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1644616 CPUtime=1.49 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 3758 0 0 0 149 0 0 0 25 0 1 0 596867527 1684086784 2431 33554432000 4194304 4587354 140737176644208 18446744073709551615 4357632 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 411154 2431 337 96 0 407716 0
[pid=25397] ppid=25395 vsize=14312 CPUtime=1.49 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 1046 0 0 0 149 0 0 0 25 0 1 0 596867527 14655488 933 33554432000 4194304 4785740 140735555147216 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 3578 933 340 145 0 623 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=0.84 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 84 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=6572 CPUtime=1.49 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 1233 0 0 0 149 0 0 0 25 0 1 0 596867527 6729728 842 33554432000 4194304 4352236 140736407257456 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 1643 842 127 39 0 723 0
[pid=25400] ppid=25395 vsize=7996 CPUtime=0.63 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 613 0 0 0 63 0 0 0 25 0 1 0 596867527 8187904 506 33554432000 4194304 4331988 140733431402656 18446744073709551615 4240230 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 1999 506 172 34 0 441 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 2147780

[startup+3.10046 s]
/proc/loadavg: 5.19 5.11 5.48 6/177 25401
/proc/meminfo: memFree=17444892/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1648492 CPUtime=3.08 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 5762 0 0 0 308 0 0 0 25 0 1 0 596867527 1688055808 3497 33554432000 4194304 4587354 140737176644208 18446744073709551615 4356836 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 412123 3497 337 96 0 408685 0
[pid=25397] ppid=25395 vsize=15116 CPUtime=3.09 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 1241 0 0 0 309 0 0 0 25 0 1 0 596867527 15478784 1128 33554432000 4194304 4785740 140735555147216 18446744073709551615 4553106 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 3779 1128 341 145 0 824 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=1.66 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 166 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134530832 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=6572 CPUtime=3.09 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 1329 0 0 0 309 0 0 0 25 0 1 0 596867527 6729728 842 33554432000 4194304 4352236 140736407257456 18446744073709551615 4327916 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 1643 842 127 39 0 723 0
[pid=25400] ppid=25395 vsize=8300 CPUtime=1.41 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 677 0 0 0 141 0 0 0 25 0 1 0 596867527 8499200 570 33554432000 4194304 4331988 140733431402656 18446744073709551615 4229451 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 2075 570 173 34 0 517 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 2152764

[startup+6.30088 s]
/proc/loadavg: 5.18 5.10 5.48 6/177 25401
/proc/meminfo: memFree=17438444/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1647612 CPUtime=6.28 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 7985 0 0 0 628 0 0 0 25 0 1 0 596867527 1687154688 3929 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 411903 3929 337 96 0 408465 0
[pid=25397] ppid=25395 vsize=16344 CPUtime=6.29 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 1547 0 0 0 629 0 0 0 25 0 1 0 596867527 16736256 1434 33554432000 4194304 4785740 140735555147216 18446744073709551615 4553224 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 4086 1434 341 145 0 1131 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=3.34 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 334 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134530309 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=6832 CPUtime=6.29 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 2002 0 0 0 629 0 0 0 25 0 1 0 596867527 6995968 907 33554432000 4194304 4352236 140736407257456 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 1708 907 127 39 0 788 0
[pid=25400] ppid=25395 vsize=8452 CPUtime=2.91 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 736 0 0 0 291 0 0 0 25 0 1 0 596867527 8654848 629 33554432000 4194304 4331988 140733431402656 18446744073709551615 4211509 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 2113 629 173 34 0 555 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 2153524

[startup+12.7008 s]
/proc/loadavg: 5.24 5.12 5.48 6/177 25402
/proc/meminfo: memFree=17431840/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1650108 CPUtime=12.69 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 11768 0 0 0 1267 2 0 0 25 0 1 0 596867527 1689710592 4750 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 412527 4750 337 96 0 409089 0
[pid=25397] ppid=25395 vsize=18048 CPUtime=12.69 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 1953 0 0 0 1269 0 0 0 25 0 1 0 596867527 18481152 1840 33554432000 4194304 4785740 140735555147216 18446744073709551615 4287216 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 4512 1840 341 145 0 1557 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=6.52 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 652 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134530487 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=8376 CPUtime=12.69 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 3188 0 0 0 1269 0 0 0 25 0 1 0 596867527 8577024 1293 33554432000 4194304 4352236 140736407257456 18446744073709551615 4271327 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 2094 1293 127 39 0 1174 0
[pid=25400] ppid=25395 vsize=9156 CPUtime=6.11 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 881 0 0 0 611 0 0 0 25 0 1 0 596867527 9375744 774 33554432000 4194304 4331988 140733431402656 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 2289 774 173 34 0 731 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 2159972

[startup+25.5065 s]
/proc/loadavg: 5.19 5.11 5.48 6/177 25402
/proc/meminfo: memFree=17420548/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1657880 CPUtime=25.49 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 18323 0 0 0 2546 3 0 0 25 0 1 0 596867527 1697669120 5409 33554432000 4194304 4587354 140737176644208 18446744073709551615 4241215 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 414470 5409 337 96 0 411032 0
[pid=25397] ppid=25395 vsize=19896 CPUtime=25.5 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 2418 0 0 0 2550 0 0 0 25 0 1 0 596867527 20373504 2305 33554432000 4194304 4785740 140735555147216 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 4974 2305 341 145 0 2019 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=12.86 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 1286 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=11064 CPUtime=25.49 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 6132 0 0 0 2549 0 0 0 25 0 1 0 596867527 11329536 1965 33554432000 4194304 4352236 140736407257456 18446744073709551615 4276539 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 2766 1965 127 39 0 1846 0
[pid=25400] ppid=25395 vsize=10836 CPUtime=12.5 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 1124 0 0 0 1250 0 0 0 25 0 1 0 596867527 11096064 1017 33554432000 4194304 4331988 140733431402656 18446744073709551615 4229463 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 2709 1017 173 34 0 1151 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 2173960

[startup+51.1011 s]
/proc/loadavg: 5.12 5.10 5.46 6/177 25403
/proc/meminfo: memFree=17406288/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1657348 CPUtime=51.09 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 27239 0 0 0 5105 4 0 0 25 0 1 0 596867527 1697124352 8246 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 414337 8246 337 96 0 410899 0
[pid=25397] ppid=25395 vsize=22588 CPUtime=51.09 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 3062 0 0 0 5109 0 0 0 25 0 1 0 596867527 23130112 2949 33554432000 4194304 4785740 140735555147216 18446744073709551615 4552553 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 5647 2949 341 145 0 2692 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=25.63 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 2563 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134530630 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=11832 CPUtime=51.09 cores=2

################
# More data... #
################

/proc/25400/statm: 21109 15669 173 34 0 19551 0
Current children cumulated CPU time (s) 3524.66
Current children cumulated vsize (KiB) 2330972

[startup+942.301 s]
/proc/loadavg: 5.09 5.09 5.22 6/177 25426
/proc/meminfo: memFree=17257036/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1764700 CPUtime=942.31 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 131399 0 0 0 94190 41 0 0 25 0 1 0 596867527 1807052800 19173 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238602 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 441175 19173 337 96 0 437737 0
[pid=25397] ppid=25395 vsize=45896 CPUtime=942.3 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 8436 0 0 0 94229 1 0 0 25 0 1 0 596867527 46997504 8323 33554432000 4194304 4785740 140735555147216 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 11474 8323 341 145 0 8519 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=468.9 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 46890 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134530522 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=36672 CPUtime=942.31 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 84086 0 0 0 94220 11 0 0 25 0 1 0 596867527 37552128 8367 33554432000 4194304 4352236 140736407257456 18446744073709551615 4328039 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 9168 8367 127 39 0 8248 0
[pid=25400] ppid=25395 vsize=84436 CPUtime=468.53 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 16744 0 0 0 46845 8 0 0 25 0 1 0 596867527 86462464 16637 33554432000 4194304 4331988 140733431402656 18446744073709551615 4291941 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 21109 16637 173 34 0 19551 0
Current children cumulated CPU time (s) 3764.35
Current children cumulated vsize (KiB) 2405988

[startup+1002.31 s]
/proc/loadavg: 5.07 5.09 5.21 6/177 25428
/proc/meminfo: memFree=17257248/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1764816 CPUtime=1002.31 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 134830 0 0 0 100189 42 0 0 25 0 1 0 596867527 1807171584 18783 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238668 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 441204 18783 337 96 0 437766 0
[pid=25397] ppid=25395 vsize=46684 CPUtime=1002.31 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 8623 0 0 0 100230 1 0 0 25 0 1 0 596867527 47804416 8510 33554432000 4194304 4785740 140735555147216 18446744073709551615 4553380 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 11671 8510 341 145 0 8716 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=498.76 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 49876 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134528926 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=33088 CPUtime=1002.31 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 87926 0 0 0 100220 11 0 0 25 0 1 0 596867527 33882112 7471 33554432000 4194304 4352236 140736407257456 18446744073709551615 4328016 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 8272 7471 127 39 0 7352 0
[pid=25400] ppid=25395 vsize=84568 CPUtime=498.37 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 17720 0 0 0 49828 9 0 0 25 0 1 0 596867527 86597632 17613 33554432000 4194304 4331988 140733431402656 18446744073709551615 4211480 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 21142 17613 173 34 0 19584 0
Current children cumulated CPU time (s) 4004.06
Current children cumulated vsize (KiB) 2403440

[startup+1062.3 s]
/proc/loadavg: 5.07 5.08 5.19 6/177 25429
/proc/meminfo: memFree=17251260/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1814032 CPUtime=1062.31 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 138430 0 0 0 106187 44 0 0 25 0 1 0 596867527 1857568768 18353 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 453508 18353 337 96 0 450070 0
[pid=25397] ppid=25395 vsize=47412 CPUtime=1062.31 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 8783 0 0 0 106230 1 0 0 25 0 1 0 596867527 48549888 8670 33554432000 4194304 4785740 140735555147216 18446744073709551615 4553375 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 11853 8670 341 145 0 8898 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=528.59 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 52859 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=36672 CPUtime=1062.31 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 90166 0 0 0 106220 11 0 0 25 0 1 0 596867527 37552128 8367 33554432000 4194304 4352236 140736407257456 18446744073709551615 4329043 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 9168 8367 127 39 0 8248 0
[pid=25400] ppid=25395 vsize=84568 CPUtime=528.22 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 18637 0 0 0 52813 9 0 0 25 0 1 0 596867527 86597632 18530 33554432000 4194304 4331988 140733431402656 18446744073709551615 4211519 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 21142 18530 173 34 0 19584 0
Current children cumulated CPU time (s) 4243.74
Current children cumulated vsize (KiB) 2456968

[startup+1122.3 s]
/proc/loadavg: 5.07 5.08 5.18 6/177 25431
/proc/meminfo: memFree=17250856/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1704360 CPUtime=1122.31 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 146414 0 0 0 112183 48 0 0 25 0 1 0 596867527 1745264640 18212 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 426090 18212 337 96 0 422652 0
[pid=25397] ppid=25395 vsize=47892 CPUtime=1122.31 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 8888 0 0 0 112230 1 0 0 25 0 1 0 596867527 49041408 8775 33554432000 4194304 4785740 140735555147216 18446744073709551615 4552514 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 11973 8775 341 145 0 9018 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=558.45 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 55845 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134528972 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=33088 CPUtime=1122.31 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 94006 0 0 0 112219 12 0 0 25 0 1 0 596867527 33882112 7471 33554432000 4194304 4352236 140736407257456 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 8272 7471 127 39 0 7352 0
[pid=25400] ppid=25395 vsize=114036 CPUtime=558.04 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 19592 0 0 0 55794 10 0 0 25 0 1 0 596867527 116772864 19485 33554432000 4194304 4331988 140733431402656 18446744073709551615 4284377 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 28509 19485 173 34 0 26951 0
Current children cumulated CPU time (s) 4483.42
Current children cumulated vsize (KiB) 2373660

[startup+1182.3 s]
/proc/loadavg: 5.06 5.08 5.17 6/177 25433
/proc/meminfo: memFree=17246624/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1756536 CPUtime=1182.32 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 157785 0 0 0 118180 52 0 0 25 0 1 0 596867527 1798692864 17620 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 439134 17620 337 96 0 435696 0
[pid=25397] ppid=25395 vsize=48396 CPUtime=1182.32 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 9004 0 0 0 118230 2 0 0 25 0 1 0 596867527 49557504 8891 33554432000 4194304 4785740 140735555147216 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 12099 8891 341 145 0 9144 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=588.26 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 58826 0 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134528464 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=35648 CPUtime=1182.31 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 95990 0 0 0 118219 12 0 0 25 0 1 0 596867527 36503552 8111 33554432000 4194304 4352236 140736407257456 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 8912 8111 127 39 0 7992 0
[pid=25400] ppid=25395 vsize=114036 CPUtime=587.91 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 20595 0 0 0 58781 10 0 0 25 0 1 0 596867527 116772864 20488 33554432000 4194304 4331988 140733431402656 18446744073709551615 4226539 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 28509 20488 173 34 0 26951 0
Current children cumulated CPU time (s) 4723.12
Current children cumulated vsize (KiB) 2428900



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.6 s]
/proc/loadavg: 5.18 5.10 5.18 6/177 25433
/proc/meminfo: memFree=17255048/32950940 swapFree=67111528/67111528
[pid=25395] ppid=25393 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/25395/stat : 25395 (ppfolio) S 25393 25395 21582 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 596867527 18763776 389 33554432000 4194304 4287625 140733772738800 18446744073709551615 215988612623 0 0 4096 65536 17321055552272334847 0 0 17 4 0 0 0
/proc/25395/statm: 4581 389 341 23 0 91 0
[pid=25396] ppid=25395 vsize=1756576 CPUtime=1201.62 cores=0
/proc/25396/stat : 25396 (cryptominisat) R 25395 25395 21582 0 -1 4202496 160367 0 0 0 120109 53 0 0 25 0 1 0 596867527 1798733824 16021 33554432000 4194304 4587354 140737176644208 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/25396/statm: 439144 16021 337 96 0 435706 0
[pid=25397] ppid=25395 vsize=48396 CPUtime=1201.62 cores=4
/proc/25397/stat : 25397 (clasp) R 25395 25395 21582 0 -1 4202496 9029 0 0 0 120160 2 0 0 25 0 1 0 596867527 49557504 8916 33554432000 4194304 4785740 140735555147216 18446744073709551615 4553440 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/25397/statm: 12099 8916 341 145 0 9144 0
[pid=25398] ppid=25395 vsize=455960 CPUtime=597.87 cores=6
/proc/25398/stat : 25398 (TNM) R 25395 25395 21582 0 -1 4202496 356 0 0 0 59786 1 0 0 25 0 1 0 596867527 466903040 253 33554432000 134512640 134534564 4292947936 18446744073709551615 134529033 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25398/statm: 113990 253 95 6 0 112656 0
[pid=25399] ppid=25395 vsize=31296 CPUtime=1201.62 cores=2
/proc/25399/stat : 25399 (lingeling) R 25395 25395 21582 0 -1 4202496 96246 0 0 0 120150 12 0 0 25 0 1 0 596867527 32047104 7023 33554432000 4194304 4352236 140736407257456 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/25399/statm: 7824 7023 127 39 0 6904 0
[pid=25400] ppid=25395 vsize=114036 CPUtime=597.52 cores=6
/proc/25400/stat : 25400 (march_hi) R 25395 25395 21582 0 -1 4202496 20927 0 0 0 59741 11 0 0 25 0 1 0 596867527 116772864 20820 33554432000 4194304 4331988 140733431402656 18446744073709551615 4240488 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/25400/statm: 28509 20820 173 34 0 26951 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 2424588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25395 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.002998
# while last known CPU time is 4800.25
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.61
CPU time (s): 4800.25
CPU user time (s): 4799.46
CPU system time (s): 0.79
CPU usage (%): 399.484
Max. virtual memory (cumulated for all children) (KiB): 4094992

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 522
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 439
involuntary context switches= 6

runsolver used 2.16167 second user time and 4.07238 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-29 10:39:28
IDJOB=3191209
IDBENCH=82940
IDSOLVER=1612
FILE ID=node117/3191209-1304066367
RUNJOBID= node117-1304062554-24496
PBS_JOBID= 13170383
Free space on /tmp= 71680 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v600-c2556-S224791863-033.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191209-1304066367/watcher-3191209-1304066367 -o /tmp/evaluation-result-3191209-1304066367/solver-3191209-1304066367 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191209-1304066367.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 97219d7d3b8dcf40225a045ad28970d7
RANDOM SEED=501234907

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      17463208 kB
Buffers:       2378480 kB
Cached:       12462412 kB
SwapCached:          0 kB
Active:        8111240 kB
Inactive:      6793796 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      17463208 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10172 kB
Writeback:           0 kB
AnonPages:       63272 kB
Mapped:          14388 kB
Slab:           519008 kB
PageTables:       4500 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   189296 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71672 MiB
End job on node117 at 2011-04-29 10:59:31