Trace number 3289859

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.01 1300.02

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_3_keyfind_1.cnf
MD5SUMff59ad0e88befc51bfa041e45143dc53
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2808
Number of clauses30432
Sum of the clauses size167020
Maximum clause length8
Minimum clause length1
Number of clauses of size 1280
Number of clauses of size 2384
Number of clauses of size 35024
Number of clauses of size 4960
Number of clauses of size 56144
Number of clauses of size over 517640

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 4
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 4

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289859-1303775868/watcher-3289859-1303775868 -o /tmp/evaluation-result-3289859-1303775868/solver-3289859-1303775868 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3289859-1303775868.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.85 9.89 8.27 1/177 12547
/proc/meminfo: memFree=20894384/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) R 12545 12547 11530 0 -1 4202496 485 0 0 0 0 0 0 0 22 0 1 0 489186584 18763776 392 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278699925 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/12547/statm: 4581 392 343 23 0 91 0

[startup+0.051965 s]
/proc/loadavg: 9.85 9.89 8.27 1/177 12547
/proc/meminfo: memFree=20894384/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 24 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100898 s]
/proc/loadavg: 9.85 9.89 8.27 1/177 12547
/proc/meminfo: memFree=20894384/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 24 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300863 s]
/proc/loadavg: 9.85 9.89 8.27 1/177 12547
/proc/meminfo: memFree=20894384/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 22 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384334501594005504 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.70079 s]
/proc/loadavg: 9.85 9.89 8.27 1/177 12547
/proc/meminfo: memFree=20894384/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 19 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335601105633280 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5007 s]
/proc/loadavg: 9.85 9.89 8.27 4/178 12568
/proc/meminfo: memFree=20886436/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384333951838191616 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1715868 CPUtime=0.54 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 4311 0 0 0 54 0 0 0 25 0 1 0 489186584 1757048832 2917 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 428967 2917 332 96 0 425529 0
[pid=12549] ppid=12547 vsize=18316 CPUtime=0.43 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 2218 0 0 0 43 0 0 0 25 0 1 0 489186584 18755584 1933 33554432000 4194304 4785740 140735059073008 18446744073709551615 4278093 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 4579 1933 341 145 0 1624 0
[pid=12550] ppid=12547 vsize=455164 CPUtime=0.5 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1227 0 0 0 50 0 0 0 25 0 1 0 489186584 466087936 1123 33554432000 134512640 134534564 4294473888 18446744073709551615 134527404 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 113791 1123 92 6 0 112457 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 2207672

[startup+3.10048 s]
/proc/loadavg: 9.30 9.77 8.24 4/178 12568
/proc/meminfo: memFree=20883336/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1720172 CPUtime=1.04 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 5574 0 0 0 104 0 0 0 25 0 1 0 489186584 1761456128 4172 33554432000 4194304 4587354 140733679733312 18446744073709551615 4239761 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 430043 4172 338 96 0 426605 0
[pid=12549] ppid=12547 vsize=19372 CPUtime=1.01 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 2463 0 0 0 101 0 0 0 25 0 1 0 489186584 19836928 2178 33554432000 4194304 4785740 140735059073008 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 4843 2178 341 145 0 1888 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=1.02 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 102 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134528473 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 2216864

[startup+6.3008 s]
/proc/loadavg: 9.30 9.77 8.24 13/202 12607
/proc/meminfo: memFree=20767516/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384334776471912448 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1729748 CPUtime=2.13 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 7601 0 0 0 213 0 0 0 25 0 1 0 489186584 1771261952 3991 33554432000 4194304 4587354 140733679733312 18446744073709551615 4388264 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 432437 3991 338 96 0 428999 0
[pid=12549] ppid=12547 vsize=21436 CPUtime=2.03 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 2978 0 0 0 203 0 0 0 25 0 1 0 489186584 21950464 2693 33554432000 4194304 4785740 140735059073008 18446744073709551615 4299680 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 5359 2693 341 145 0 2404 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=2.1 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 210 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134530630 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 2228504

[startup+12.7007 s]
/proc/loadavg: 9.52 9.81 8.26 13/202 12607
/proc/meminfo: memFree=20718536/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384334364155052032 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1722828 CPUtime=4.24 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 11066 0 0 0 423 1 0 0 25 0 1 0 489186584 1764175872 4887 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238347 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 430707 4887 338 96 0 427269 0
[pid=12549] ppid=12547 vsize=23180 CPUtime=4.21 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 3428 0 0 0 421 0 0 0 25 0 1 0 489186584 23736320 3143 33554432000 4194304 4785740 140735059073008 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 5795 3143 341 145 0 2840 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=4.22 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 422 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 3073467 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 2223328

[startup+25.5004 s]
/proc/loadavg: 10.14 9.93 8.32 13/202 12608
/proc/meminfo: memFree=20683416/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1730916 CPUtime=8.54 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 16765 0 0 0 852 2 0 0 25 0 1 0 489186584 1772457984 6709 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238958 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 432729 6709 338 96 0 429291 0
[pid=12549] ppid=12547 vsize=26712 CPUtime=8.43 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 4259 0 0 0 843 0 0 0 25 0 1 0 489186584 27353088 3974 33554432000 4194304 4785740 140735059073008 18446744073709551615 4278016 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 6678 3974 341 145 0 3723 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=8.5 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 850 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134528955 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 2234948

[startup+51.1009 s]
/proc/loadavg: 10.77 10.10 8.42 13/202 12608
/proc/meminfo: memFree=20624968/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384334364155052032 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=50580 CPUtime=17.04 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 23263 0 0 0 1701 3 0 0 25 0 1 0 489186584 51793920 9386 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 12645 9386 338 96 0 9207 0
[pid=12549] ppid=12547 vsize=32476 CPUtime=17.01 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 5682 0 0 0 1701 0 0 0 25 0 1 0 489186584 33255424 5397 33554432000 4194304 4785740 140735059073008 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 8119 5397 341 145 0 5164 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=17.02 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 1702 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134530509 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 560376

[startup+102.307 s]
/proc/loadavg: 11.51 10.41 8.62 13/202 12610
/proc/meminfo: memFree=20579568/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335463666679808 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1760032 CPUtime=34.14 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 29463 0 0 0 3410 4 0 0 25 0 1 0 489186584 1802272768 11647 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 440008 11647 338 96 0 436570 0
[pid=12549] ppid=12547 vsize=43104 CPUtime=34.05 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 8331 0 0 0 3404 1 0 0 25 0 1 0 489186584 44138496 8046 33554432000 4194304 4785740 140735059073008 18446744073709551615 4287229 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 10776 8046 341 145 0 7821 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=34.1 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 3410 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 2280456

[startup+162.301 s]
/proc/loadavg: 11.80 10.68 8.82 13/202 12611
/proc/meminfo: memFree=20550276/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384333951838191616 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1751260 CPUtime=54.13 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 35614 0 0 0 5408 5 0 0 25 0 1 0 489186584 1793290240 11641 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 437815 11641 338 96 0 434377 0
[pid=12549] ppid=12547 vsize=46232 CPUtime=54.05 cores=4

################
# More data... #
################

/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 822.29
Current children cumulated vsize (KiB) 627912

[startup+882.301 s]
/proc/loadavg: 12.07 11.89 10.53 13/202 12642
/proc/meminfo: memFree=20349264/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335051349819392 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=64128 CPUtime=294.09 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 109024 0 0 0 29388 21 0 0 25 0 1 0 489186584 65667072 12652 33554432000 4194304 4587354 140733679733312 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 16032 12652 338 96 0 12594 0
[pid=12549] ppid=12547 vsize=86464 CPUtime=294.07 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 18710 0 0 0 29404 3 0 0 25 0 1 0 489186584 88539136 18425 33554432000 4194304 4785740 140735059073008 18446744073709551615 4553366 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 21616 18425 341 145 0 18661 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=294.13 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 29413 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 627912

[startup+942.301 s]
/proc/loadavg: 12.03 11.91 10.61 13/202 12644
/proc/meminfo: memFree=20328772/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335188788772864 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1776776 CPUtime=314.09 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 112410 0 0 0 31387 22 0 0 25 0 1 0 489186584 1819418624 15994 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 444194 15994 338 96 0 440756 0
[pid=12549] ppid=12547 vsize=88600 CPUtime=314.07 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 19224 0 0 0 31404 3 0 0 25 0 1 0 489186584 90726400 18939 33554432000 4194304 4785740 140735059073008 18446744073709551615 4286941 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 22150 18939 341 145 0 19195 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=314.14 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 31414 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134528918 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 2342696

[startup+1002.3 s]
/proc/loadavg: 12.01 11.92 10.70 13/202 12646
/proc/meminfo: memFree=20315224/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335188788772864 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=64128 CPUtime=334.09 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 113186 0 0 0 33387 22 0 0 25 0 1 0 489186584 65667072 12652 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 16032 12652 338 96 0 12594 0
[pid=12549] ppid=12547 vsize=94108 CPUtime=334.06 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 20585 0 0 0 33403 3 0 0 25 0 1 0 489186584 96366592 20300 33554432000 4194304 4785740 140735059073008 18446744073709551615 4287022 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 23527 20300 341 145 0 20572 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=334.14 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 33414 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134530509 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 635556

[startup+1062.3 s]
/proc/loadavg: 12.00 11.93 10.77 13/202 12647
/proc/meminfo: memFree=20299316/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335326227726336 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=82776 CPUtime=354.09 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 119478 0 0 0 35385 24 0 0 25 0 1 0 489186584 84762624 14708 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 20694 14708 338 96 0 17256 0
[pid=12549] ppid=12547 vsize=100600 CPUtime=354.06 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 22197 0 0 0 35402 4 0 0 25 0 1 0 489186584 103014400 21912 33554432000 4194304 4785740 140735059073008 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 25150 21912 341 145 0 22195 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=354.15 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 35415 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134528417 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 660696

[startup+1122.3 s]
/proc/loadavg: 12.00 11.94 10.85 13/202 12649
/proc/meminfo: memFree=20304384/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335326227726336 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1767748 CPUtime=374.1 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 124297 0 0 0 37385 25 0 0 25 0 1 0 489186584 1810173952 15035 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 441937 15035 338 96 0 438499 0
[pid=12549] ppid=12547 vsize=104624 CPUtime=374.06 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 23174 0 0 0 37402 4 0 0 25 0 1 0 489186584 107134976 22889 33554432000 4194304 4785740 140735059073008 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 26156 22889 341 145 0 23201 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=374.15 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 37415 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 3075092 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 2349692

[startup+1182.3 s]
/proc/loadavg: 12.04 11.97 10.92 13/202 12650
/proc/meminfo: memFree=20283760/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335463666679808 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1790228 CPUtime=394.1 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 129034 0 0 0 39384 26 0 0 25 0 1 0 489186584 1833193472 15164 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 447557 15164 338 96 0 444119 0
[pid=12549] ppid=12547 vsize=104624 CPUtime=394.06 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 23179 0 0 0 39402 4 0 0 25 0 1 0 489186584 107134976 22894 33554432000 4194304 4785740 140735059073008 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 26156 22894 341 145 0 23201 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=394.15 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 39415 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134530598 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 2372172

[startup+1242.3 s]
/proc/loadavg: 12.01 11.97 10.99 13/202 12652
/proc/meminfo: memFree=20282628/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335463666679808 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1766364 CPUtime=414.11 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 133773 0 0 0 41384 27 0 0 25 0 1 0 489186584 1808756736 15115 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 441591 15115 338 96 0 438153 0
[pid=12549] ppid=12547 vsize=108848 CPUtime=414.05 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 24231 0 0 0 41401 4 0 0 25 0 1 0 489186584 111460352 23946 33554432000 4194304 4785740 140735059073008 18446744073709551615 4287178 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 27212 23946 341 145 0 24257 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=414.14 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 41414 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 134530538 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 1242.3
Current children cumulated vsize (KiB) 2352532



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.00 11.97 11.05 13/202 12654
/proc/meminfo: memFree=20297464/32950904 swapFree=67082284/67111528
[pid=12547] ppid=12545 vsize=18324 CPUtime=0 cores=4,6
/proc/12547/stat : 12547 (ppfolio) S 12545 12547 11530 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 489186584 18763776 394 33554432000 4194304 4287625 140733611157168 18446744073709551615 237278899727 0 0 4096 65536 4384335601105633280 0 0 17 6 0 0 0
/proc/12547/statm: 4581 394 345 23 0 91 0
[pid=12548] ppid=12547 vsize=1766928 CPUtime=433.37 cores=4
/proc/12548/stat : 12548 (cryptominisat) R 12547 12547 11530 0 -1 4202496 138486 0 0 0 43309 28 0 0 25 0 1 0 489186584 1809334272 15032 33554432000 4194304 4587354 140733679733312 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/12548/statm: 441732 15032 338 96 0 438294 0
[pid=12549] ppid=12547 vsize=108848 CPUtime=433.3 cores=4
/proc/12549/stat : 12549 (clasp) R 12547 12547 11530 0 -1 4202496 24238 0 0 0 43326 4 0 0 25 0 1 0 489186584 111460352 23953 33554432000 4194304 4785740 140735059073008 18446744073709551615 237278577312 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/12549/statm: 27212 23953 341 145 0 24257 0
[pid=12550] ppid=12547 vsize=458996 CPUtime=433.34 cores=4
/proc/12550/stat : 12550 (TNM) R 12547 12547 11530 0 -1 4202496 1439 0 0 0 43334 0 0 0 25 0 1 0 489186584 470011904 1335 33554432000 134512640 134534564 4294473888 18446744073709551615 3074351 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/12550/statm: 114749 1335 95 6 0 113415 0
Current children cumulated CPU time (s) 1300.01
Current children cumulated vsize (KiB) 2353096

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12547 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 1300.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.02
CPU time (s): 1300.01
CPU user time (s): 1299.69
CPU system time (s): 0.32
CPU usage (%): 99.9995
Max. virtual memory (cumulated for all children) (KiB): 4078632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 500
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 284
involuntary context switches= 3

runsolver used 2.03169 second user time and 5.07423 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-26 01:57:48
IDJOB=3289859
IDBENCH=83408
IDSOLVER=1613
FILE ID=node121/3289859-1303775868
RUNJOBID= node121-1303774563-12394
PBS_JOBID= 13157167
Free space on /tmp= 72076 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_3_keyfind_1.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289859-1303775868/watcher-3289859-1303775868 -o /tmp/evaluation-result-3289859-1303775868/solver-3289859-1303775868 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3289859-1303775868.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= ff59ad0e88befc51bfa041e45143dc53
RANDOM SEED=500597999

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20894416 kB
Buffers:       2148508 kB
Cached:        9355760 kB
SwapCached:       2776 kB
Active:        8564708 kB
Inactive:      2980292 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20894416 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           10896 kB
Writeback:           0 kB
AnonPages:       38948 kB
Mapped:          14136 kB
Slab:           445716 kB
PageTables:       5060 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   223092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72044 MiB
End job on node121 at 2011-04-26 02:19:30