Trace number 3191434

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1299.98 1300.05

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v40000-c168000-S845438593-067-UNKNOWN.cnf
MD5SUM3b06c2c5c22c8501e021c8b11d20bcd0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1042.77
Satisfiable
(Un)Satisfiability was proved
Number of variables40000
Number of clauses168000
Sum of the clauses size504000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3168000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.05	This is pico-portfolio, a naive parallel portfolio
0.00/0.05	Copyright (C) 2011 Olivier Roussel
0.00/0.05	Using 1 processing units
0.00/0.05	This portfolio uses the following solvers:
0.00/0.05	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.05	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.05	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.05	Starting cryptominisat 2.7.1 on core(s) 5
0.00/0.05	Starting clasp 1.3.6 on core(s) 5
0.00/0.05	Starting TNM 2009 on core(s) 5

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191434-1302537010/watcher-3191434-1302537010 -o /tmp/evaluation-result-3191434-1302537010/solver-3191434-1302537010 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3191434-1302537010.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 9/198 24372
/proc/meminfo: memFree=15134948/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=2712 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4194304 85 0 0 0 0 0 0 0 18 0 1 0 443931725 2777088 37 33554432000 4194304 4287625 140737088529408 18446744073709551615 231890566791 0 2147483391 4096 0 18446744071699962003 0 0 17 5 0 0 0
/proc/24372/statm: 678 37 27 23 0 23 0

[startup+0.0941071 s]
/proc/loadavg: 1.00 1.00 1.00 9/198 24372
/proc/meminfo: memFree=15134948/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 19 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101103 s]
/proc/loadavg: 1.00 1.00 1.00 9/198 24372
/proc/meminfo: memFree=15134948/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 19 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301073 s]
/proc/loadavg: 1.00 1.00 1.00 9/198 24372
/proc/meminfo: memFree=15134948/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 17 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624317801042542592 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701011 s]
/proc/loadavg: 1.00 1.00 1.00 9/198 24372
/proc/meminfo: memFree=15134948/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 17 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624317801042542592 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50085 s]
/proc/loadavg: 1.00 1.00 1.00 13/202 24376
/proc/meminfo: memFree=15054188/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 17 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624317801042542592 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=49204 CPUtime=0.24 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 7681 0 0 0 24 0 0 0 19 0 1 0 443931730 50384896 7402 33554432000 4194304 4587354 140735484510768 18446744073709551615 231895151301 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 12301 7402 308 96 0 8863 0
[pid=24375] ppid=24372 vsize=33768 CPUtime=1.18 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 7742 0 0 0 118 0 0 0 18 0 1 0 443931730 34578432 5654 33554432000 4194304 4785740 140736544987376 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 8442 5654 340 145 0 5487 0
[pid=24376] ppid=24372 vsize=452132 CPUtime=0.01 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 347 0 0 0 1 0 0 0 20 0 1 0 443931730 462983168 244 33554432000 134512640 134534564 4293947424 18446744073709551615 10128946 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 113033 244 90 6 0 111699 0
Current children cumulated CPU time (s) 1.43
Current children cumulated vsize (KiB) 553428

[startup+3.10055 s]
/proc/loadavg: 2.04 1.22 1.07 13/202 24376
/proc/meminfo: memFree=15020708/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318488237309952 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=60000 CPUtime=0.74 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 13293 0 0 0 73 1 0 0 19 0 1 0 443931730 61440000 10107 33554432000 4194304 4587354 140735484510768 18446744073709551615 4248842 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 15000 10107 325 96 0 11562 0
[pid=24375] ppid=24372 vsize=33908 CPUtime=1.78 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 7843 0 0 0 178 0 0 0 19 0 1 0 443931730 34721792 5755 33554432000 4194304 4785740 140736544987376 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 8477 5755 340 145 0 5522 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=0.5 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 50 0 0 0 22 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134529953 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 3.02
Current children cumulated vsize (KiB) 580200

[startup+6.30094 s]
/proc/loadavg: 2.04 1.22 1.07 13/202 24376
/proc/meminfo: memFree=14992456/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318488237309952 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=60000 CPUtime=1.81 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 14136 0 0 0 180 1 0 0 22 0 1 0 443931730 61440000 10947 33554432000 4194304 4587354 140735484510768 18446744073709551615 4238104 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 15000 10947 326 96 0 11562 0
[pid=24375] ppid=24372 vsize=38212 CPUtime=2.82 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 8900 0 0 0 281 1 0 0 22 0 1 0 443931730 39129088 6812 33554432000 4194304 4785740 140736544987376 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 9553 6812 340 145 0 6598 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=1.6 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 160 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134528273 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 584504

[startup+12.7007 s]
/proc/loadavg: 3.57 1.57 1.19 13/202 24376
/proc/meminfo: memFree=14911884/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318625676263424 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=97504 CPUtime=3.94 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 15581 0 0 0 393 1 0 0 25 0 1 0 443931730 99844096 12389 33554432000 4194304 4587354 140735484510768 18446744073709551615 4238297 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 24376 12389 326 96 0 20938 0
[pid=24375] ppid=24372 vsize=48500 CPUtime=4.99 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 11464 0 0 0 498 1 0 0 25 0 1 0 443931730 49664000 9376 33554432000 4194304 4785740 140736544987376 18446744073709551615 4552955 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 12125 9376 340 145 0 9170 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=3.7 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 370 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 12.63
Current children cumulated vsize (KiB) 632296

[startup+25.5003 s]
/proc/loadavg: 4.87 1.91 1.30 13/202 24377
/proc/meminfo: memFree=14879176/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624319037993123840 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=97504 CPUtime=8.21 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 18229 0 0 0 819 2 0 0 25 0 1 0 443931730 99844096 15029 33554432000 4194304 4587354 140735484510768 18446744073709551615 4238297 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 24376 15029 326 96 0 20938 0
[pid=24375] ppid=24372 vsize=65704 CPUtime=9.21 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 15763 0 0 0 919 2 0 0 25 0 1 0 443931730 67280896 13675 33554432000 4194304 4785740 140736544987376 18446744073709551615 4304256 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 16426 13675 340 145 0 13471 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=8 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 800 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134529082 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 25.42
Current children cumulated vsize (KiB) 649500

[startup+51.1005 s]
/proc/loadavg: 7.08 2.67 1.57 12/201 24377
/proc/meminfo: memFree=14727576/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318763115216896 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=1915880 CPUtime=16.74 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 48582 0 0 0 1668 6 0 0 25 0 1 0 443931730 1961861120 38576 33554432000 4194304 4587354 140735484510768 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 478970 38576 337 96 0 475532 0
[pid=24375] ppid=24372 vsize=101360 CPUtime=17.79 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 24613 0 0 0 1776 3 0 0 25 0 1 0 443931730 103792640 22525 33554432000 4194304 4785740 140736544987376 18446744073709551615 4304043 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 25340 22525 340 145 0 22385 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=16.5 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 1650 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 51.03
Current children cumulated vsize (KiB) 2503532

[startup+102.307 s]
/proc/loadavg: 9.21 4.02 2.09 11/200 24379
/proc/meminfo: memFree=14741280/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624317663603589120 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=161304 CPUtime=33.83 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 73289 0 0 0 3373 10 0 0 25 0 1 0 443931730 165175296 20265 33554432000 4194304 4587354 140735484510768 18446744073709551615 231895187211 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 40326 20265 337 96 0 36888 0
[pid=24375] ppid=24372 vsize=150460 CPUtime=34.8 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 36778 0 0 0 3475 5 0 0 25 0 1 0 443931730 154071040 34690 33554432000 4194304 4785740 140736544987376 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 37615 34690 340 145 0 34660 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=33.6 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 3360 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 798056

[startup+162.301 s]
/proc/loadavg: 9.68 5.02 2.54 11/200 24380
/proc/meminfo: memFree=14784776/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318488237309952 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=148832 CPUtime=53.83 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 101449 0 0 0 5368 15 0 0 25 0 1 0 443931730 152403968 16141 33554432000 4194304 4587354 140735484510768 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 37208 16141 337 96 0 33770 0
[pid=24375] ppid=24372 vsize=157524 CPUtime=54.81 cores=5

################
# More data... #
################

/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 822.25
Current children cumulated vsize (KiB) 2698152

[startup+882.301 s]
/proc/loadavg: 10.04 9.56 6.57 11/200 24409
/proc/meminfo: memFree=14481372/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318625676263424 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=1846144 CPUtime=293.79 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 319025 0 0 0 29326 53 0 0 25 0 1 0 443931730 1890451456 25650 33554432000 4194304 4587354 140735484510768 18446744073709551615 4241101 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 461536 25650 337 96 0 458098 0
[pid=24375] ppid=24372 vsize=320108 CPUtime=294.87 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 78318 0 0 0 29472 15 0 0 25 0 1 0 443931730 327790592 76230 33554432000 4194304 4785740 140736544987376 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 80027 76230 340 145 0 77072 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=293.59 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 29359 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 882.25
Current children cumulated vsize (KiB) 2652544

[startup+942.301 s]
/proc/loadavg: 10.01 9.64 6.76 11/200 24410
/proc/meminfo: memFree=14305892/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624317938481496064 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=2008016 CPUtime=313.79 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 366601 0 0 0 31319 60 0 0 25 0 1 0 443931730 2056208384 65909 33554432000 4194304 4587354 140735484510768 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 502004 65909 337 96 0 498566 0
[pid=24375] ppid=24372 vsize=329564 CPUtime=314.86 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 80686 0 0 0 31471 15 0 0 25 0 1 0 443931730 337473536 78598 33554432000 4194304 4785740 140736544987376 18446744073709551615 4552530 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 82391 78598 340 145 0 79436 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=313.6 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 31360 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 942.25
Current children cumulated vsize (KiB) 2823872

[startup+1002.3 s]
/proc/loadavg: 10.00 9.70 6.98 11/200 24412
/proc/meminfo: memFree=14455160/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318488237309952 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=94360 CPUtime=333.79 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 373522 0 0 0 33317 62 0 0 25 0 1 0 443931730 96624640 18214 33554432000 4194304 4587354 140735484510768 18446744073709551615 4238282 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 23590 18214 337 96 0 20152 0
[pid=24375] ppid=24372 vsize=365476 CPUtime=334.86 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 89655 0 0 0 33469 17 0 0 25 0 1 0 443931730 374247424 87567 33554432000 4194304 4785740 140736544987376 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 91369 87567 340 145 0 88414 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=333.61 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 33361 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134530307 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 1002.26
Current children cumulated vsize (KiB) 946128

[startup+1062.3 s]
/proc/loadavg: 10.00 9.75 7.15 11/200 24413
/proc/meminfo: memFree=14413716/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318625676263424 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=1850188 CPUtime=353.79 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 383124 0 0 0 35314 65 0 0 25 0 1 0 443931730 1894592512 20019 33554432000 4194304 4587354 140735484510768 18446744073709551615 4238739 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 462547 20019 337 96 0 459109 0
[pid=24375] ppid=24372 vsize=365476 CPUtime=354.86 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 89671 0 0 0 35469 17 0 0 25 0 1 0 443931730 374247424 87583 33554432000 4194304 4785740 140736544987376 18446744073709551615 4551074 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 91369 87583 340 145 0 88414 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=353.62 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 35362 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134525871 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 1062.27
Current children cumulated vsize (KiB) 2701956

[startup+1122.3 s]
/proc/loadavg: 10.06 9.82 7.35 11/200 24415
/proc/meminfo: memFree=14415552/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318763115216896 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=1883256 CPUtime=373.78 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 390940 0 0 0 37311 67 0 0 25 0 1 0 443931730 1928454144 20020 33554432000 4194304 4587354 140735484510768 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 470814 20020 337 96 0 467376 0
[pid=24375] ppid=24372 vsize=382664 CPUtime=374.86 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 93885 0 0 0 37468 18 0 0 25 0 1 0 443931730 391847936 91797 33554432000 4194304 4785740 140736544987376 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 95666 91797 340 145 0 92711 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=373.62 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 37362 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134526128 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 1122.26
Current children cumulated vsize (KiB) 2752212

[startup+1182.3 s]
/proc/loadavg: 10.02 9.85 7.50 11/200 24417
/proc/meminfo: memFree=14351792/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624318900554170368 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=1835320 CPUtime=393.78 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 399221 0 0 0 39309 69 0 0 25 0 1 0 443931730 1879367680 20030 33554432000 4194304 4587354 140735484510768 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 458830 20030 337 96 0 455392 0
[pid=24375] ppid=24372 vsize=453920 CPUtime=394.85 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 111524 0 0 0 39463 22 0 0 25 0 1 0 443931730 464814080 109436 33554432000 4194304 4785740 140736544987376 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 113480 109436 340 145 0 110525 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=393.63 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 39363 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 1182.26
Current children cumulated vsize (KiB) 2775532

[startup+1242.3 s]
/proc/loadavg: 10.01 9.88 7.67 11/200 24418
/proc/meminfo: memFree=14300304/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624319037993123840 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=94360 CPUtime=413.78 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 407785 0 0 0 41307 71 0 0 25 0 1 0 443931730 96624640 20030 33554432000 4194304 4587354 140735484510768 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 23590 20030 337 96 0 20152 0
[pid=24375] ppid=24372 vsize=472076 CPUtime=414.86 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 116008 0 0 0 41462 24 0 0 25 0 1 0 443931730 483405824 113920 33554432000 4194304 4785740 140736544987376 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 118019 113920 340 145 0 115064 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=413.64 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 41364 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134528620 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 1242.28
Current children cumulated vsize (KiB) 1052728



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.05 9.91 7.80 4/186 24444
/proc/meminfo: memFree=14565224/32950928 swapFree=67111528/67111528
[pid=24372] ppid=24370 vsize=18324 CPUtime=0 cores=5,7
/proc/24372/stat : 24372 (ppfolio) S 24370 24372 24303 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 443931725 18763776 394 33554432000 4194304 4287625 140737088529408 18446744073709551615 231895510543 0 0 4096 65536 10624319175432077312 0 0 17 7 0 0 0
/proc/24372/statm: 4581 394 345 23 0 91 0
[pid=24374] ppid=24372 vsize=167464 CPUtime=433.07 cores=5
/proc/24374/stat : 24374 (cryptominisat) R 24372 24372 24303 0 -1 4202496 416185 0 0 0 43235 72 0 0 25 0 1 0 443931730 171483136 28403 33554432000 4194304 4587354 140735484510768 18446744073709551615 4239479 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/24374/statm: 41866 28403 337 96 0 38428 0
[pid=24375] ppid=24372 vsize=472076 CPUtime=434.07 cores=5
/proc/24375/stat : 24375 (clasp) R 24372 24372 24303 0 -1 4202496 116008 0 0 0 43383 24 0 0 25 0 1 0 443931730 483405824 113920 33554432000 4194304 4785740 140736544987376 18446744073709551615 4550319 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/24375/statm: 118019 113920 340 145 0 115064 0
[pid=24376] ppid=24372 vsize=467968 CPUtime=432.84 cores=5
/proc/24376/stat : 24376 (TNM) R 24372 24372 24303 0 -1 4202496 6719 0 0 0 43284 0 0 0 25 0 1 0 443931730 479199232 6615 33554432000 134512640 134534564 4293947424 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/24376/statm: 116992 6615 95 6 0 115658 0
Current children cumulated CPU time (s) 1299.98
Current children cumulated vsize (KiB) 1125832

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24372 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.004998
# while last known CPU time is 1299.98
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.05
CPU time (s): 1299.98
CPU user time (s): 1299.02
CPU system time (s): 0.96
CPU usage (%): 99.9943
Max. virtual memory (cumulated for all children) (KiB): 4557428

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 502
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 185
involuntary context switches= 3

runsolver used 2.17367 second user time and 4.92925 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-11 17:50:10
IDJOB=3191434
IDBENCH=82565
IDSOLVER=1613
FILE ID=node114/3191434-1302537010
RUNJOBID= node114-1302537010-24324
PBS_JOBID= 12951125
Free space on /tmp= 71804 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v40000-c168000-S845438593-067-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191434-1302537010/watcher-3191434-1302537010 -o /tmp/evaluation-result-3191434-1302537010/solver-3191434-1302537010 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3191434-1302537010.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 3b06c2c5c22c8501e021c8b11d20bcd0
RANDOM SEED=1985139401

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      15135360 kB
Buffers:        694368 kB
Cached:       16601056 kB
SwapCached:          0 kB
Active:        5187580 kB
Inactive:     12188856 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      15135360 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           45412 kB
Writeback:           0 kB
AnonPages:       80860 kB
Mapped:          16268 kB
Slab:           371652 kB
PageTables:       5800 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1634252 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71804 MiB
End job on node114 at 2011-04-11 18:11:52