Trace number 3289951

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.04 1300.01

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_1_keyfind_1.cnf
MD5SUM5092a9db644d53c7bc023e4dff206812
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1192
Number of clauses10656
Sum of the clauses size56868
Maximum clause length8
Minimum clause length1
Number of clauses of size 1264
Number of clauses of size 2128
Number of clauses of size 32016
Number of clauses of size 4320
Number of clauses of size 52048
Number of clauses of size over 55880

Solver Data 

0.00/0.01	This is pico-portfolio, a naive parallel portfolio
0.00/0.01	Copyright (C) 2011 Olivier Roussel
0.00/0.01	Using 1 processing units
0.00/0.01	This portfolio uses the following solvers:
0.00/0.01	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.01	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.01	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.01	Starting cryptominisat 2.7.1 on core(s) 5
0.00/0.01	Starting clasp 1.3.6 on core(s) 5
0.00/0.01	Starting TNM 2009 on core(s) 5
1300.02/1300.01	Done

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289951-1303775871/watcher-3289951-1303775871 -o /tmp/evaluation-result-3289951-1303775871/solver-3289951-1303775871 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3289951-1303775871.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.30 9.77 8.24 8/190 12590
/proc/meminfo: memFree=20842968/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) R 12588 12590 11530 0 -1 4202496 483 0 0 0 0 0 0 0 21 0 1 0 489186947 18763776 392 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278699925 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/12590/statm: 4581 392 343 23 0 91 0

[startup+0.081968 s]
/proc/loadavg: 9.30 9.77 8.24 8/190 12590
/proc/meminfo: memFree=20842968/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 23 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374201538478080 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100963 s]
/proc/loadavg: 9.30 9.77 8.24 8/190 12590
/proc/meminfo: memFree=20842968/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 23 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374201538478080 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300927 s]
/proc/loadavg: 9.30 9.77 8.24 8/190 12590
/proc/meminfo: memFree=20842968/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 22 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700857 s]
/proc/loadavg: 9.30 9.77 8.24 8/190 12590
/proc/meminfo: memFree=20842968/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 17 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631373514343710720 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50071 s]
/proc/loadavg: 9.30 9.77 8.24 13/202 12607
/proc/meminfo: memFree=20804324/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631373926660571136 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=729564 CPUtime=0.45 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 2407 0 0 0 45 0 0 0 25 0 1 0 489186947 747073536 1401 33554432000 4194304 4587354 140737160036080 18446744073709551615 4236780 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 182391 1401 332 96 0 178953 0
[pid=12592] ppid=12590 vsize=15460 CPUtime=0.52 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 1321 0 0 0 52 0 0 0 25 0 1 0 489186947 15831040 1202 33554432000 4194304 4785740 140735588910848 18446744073709551615 4553029 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 3865 1202 341 145 0 910 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=0.5 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 50 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134530568 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 1220228

[startup+3.10043 s]
/proc/loadavg: 9.30 9.77 8.24 13/202 12607
/proc/meminfo: memFree=20747180/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374476416385024 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=738144 CPUtime=1.04 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 4362 0 0 0 104 0 0 0 25 0 1 0 489186947 755859456 2646 33554432000 4194304 4587354 140737160036080 18446744073709551615 4241080 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 184536 2646 338 96 0 181098 0
[pid=12592] ppid=12590 vsize=15992 CPUtime=1.02 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 1470 0 0 0 102 0 0 0 25 0 1 0 489186947 16375808 1351 33554432000 4194304 4785740 140735588910848 18446744073709551615 4277442 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 3998 1351 341 145 0 1043 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=1.01 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 101 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134528392 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 1229340

[startup+6.30087 s]
/proc/loadavg: 9.52 9.81 8.26 13/202 12607
/proc/meminfo: memFree=20732516/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374476416385024 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=735496 CPUtime=2.05 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 5675 0 0 0 205 0 0 0 25 0 1 0 489186947 753147904 2649 33554432000 4194304 4587354 140737160036080 18446744073709551615 4388352 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 183874 2649 338 96 0 180436 0
[pid=12592] ppid=12590 vsize=17360 CPUtime=2.12 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 1801 0 0 0 212 0 0 0 25 0 1 0 489186947 17776640 1682 33554432000 4194304 4785740 140735588910848 18446744073709551615 4277715 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 4340 1682 341 145 0 1385 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=2.1 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 210 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134528955 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 1228060

[startup+12.7008 s]
/proc/loadavg: 9.80 9.86 8.29 13/202 12607
/proc/meminfo: memFree=20701052/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631373926660571136 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=740404 CPUtime=4.24 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 8726 0 0 0 423 1 0 0 25 0 1 0 489186947 758173696 4039 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 185101 4039 338 96 0 181663 0
[pid=12592] ppid=12590 vsize=18312 CPUtime=4.22 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 2024 0 0 0 422 0 0 0 25 0 1 0 489186947 18751488 1905 33554432000 4194304 4785740 140735588910848 18446744073709551615 4312630 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 4578 1905 341 145 0 1623 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=4.22 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 422 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134528918 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1233920

[startup+25.5005 s]
/proc/loadavg: 10.29 9.97 8.34 13/202 12608
/proc/meminfo: memFree=20674240/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631375026172198912 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=740636 CPUtime=8.45 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 12932 0 0 0 843 2 0 0 25 0 1 0 489186947 758411264 3982 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 185159 3982 338 96 0 181721 0
[pid=12592] ppid=12590 vsize=19704 CPUtime=8.51 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 2346 0 0 0 851 0 0 0 25 0 1 0 489186947 20176896 2227 33554432000 4194304 4785740 140735588910848 18446744073709551615 237278537919 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 4926 2227 341 145 0 1971 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=8.5 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 850 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134530980 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 1235544

[startup+51.1009 s]
/proc/loadavg: 10.87 10.13 8.44 13/202 12608
/proc/meminfo: memFree=20640840/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=746656 CPUtime=17.04 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 19725 0 0 0 1700 4 0 0 25 0 1 0 489186947 764575744 5304 33554432000 4194304 4587354 140737160036080 18446744073709551615 4243904 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 186664 5304 338 96 0 183226 0
[pid=12592] ppid=12590 vsize=21812 CPUtime=17.01 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 2847 0 0 0 1701 0 0 0 25 0 1 0 489186947 22335488 2728 33554432000 4194304 4785740 140735588910848 18446744073709551615 4286927 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 5453 2728 341 145 0 2498 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=17.02 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 1702 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134528888 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 1243672

[startup+102.308 s]
/proc/loadavg: 11.51 10.41 8.62 13/202 12610
/proc/meminfo: memFree=20577956/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374201538478080 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=753644 CPUtime=34.07 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 29253 0 0 0 3401 6 0 0 25 0 1 0 489186947 771731456 6684 33554432000 4194304 4587354 140737160036080 18446744073709551615 4239304 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 188411 6684 338 96 0 184973 0
[pid=12592] ppid=12590 vsize=24556 CPUtime=34.11 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 3511 0 0 0 3411 0 0 0 25 0 1 0 489186947 25145344 3392 33554432000 4194304 4785740 140735588910848 18446744073709551615 4286941 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 6139 3392 341 145 0 3184 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=34.1 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 3410 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134529812 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1253404

[startup+162.301 s]
/proc/loadavg: 11.82 10.70 8.83 13/202 12611
/proc/meminfo: memFree=20547300/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374064099524608 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=63724 CPUtime=54.07 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 40852 0 0 0 5397 10 0 0 25 0 1 0 489186947 65253376 10868 33554432000 4194304 4587354 140737160036080 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 15931 10868 338 96 0 12493 0
[pid=12592] ppid=12590 vsize=27408 CPUtime=54.1 cores=5

################
# More data... #
################

[startup+822.301 s]
/proc/loadavg: 12.00 11.85 10.43 13/202 12641
/proc/meminfo: memFree=20304904/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=55032 CPUtime=274.1 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 108258 0 0 0 27377 33 0 0 25 0 1 0 489186947 56352768 9482 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 13758 9482 338 96 0 10320 0
[pid=12592] ppid=12590 vsize=37972 CPUtime=274.08 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 6614 0 0 0 27407 1 0 0 25 0 1 0 489186947 38883328 6495 33554432000 4194304 4785740 140735588910848 18446744073709551615 4550348 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 9493 6495 341 145 0 6538 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=274.12 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 27412 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134528875 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 568208

[startup+882.301 s]
/proc/loadavg: 12.07 11.89 10.53 13/202 12642
/proc/meminfo: memFree=20344800/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631373789221617664 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=55100 CPUtime=294.09 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 111914 0 0 0 29375 34 0 0 25 0 1 0 489186947 56422400 9863 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238947 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 13775 9863 338 96 0 10337 0
[pid=12592] ppid=12590 vsize=38348 CPUtime=294.07 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 6673 0 0 0 29406 1 0 0 25 0 1 0 489186947 39268352 6554 33554432000 4194304 4785740 140735588910848 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 9587 6554 341 145 0 6632 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=294.13 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 29413 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134528652 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 568652

[startup+942.301 s]
/proc/loadavg: 12.02 11.91 10.62 13/202 12644
/proc/meminfo: memFree=20326788/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631373789221617664 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=757548 CPUtime=314.09 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 116887 0 0 0 31373 36 0 0 25 0 1 0 489186947 775729152 8195 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238602 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 189387 8195 338 96 0 185949 0
[pid=12592] ppid=12590 vsize=38856 CPUtime=314.07 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 6796 0 0 0 31406 1 0 0 25 0 1 0 489186947 39788544 6677 33554432000 4194304 4785740 140735588910848 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 9714 6677 341 145 0 6759 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=314.14 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 31414 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134529033 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 1271608

[startup+1002.3 s]
/proc/loadavg: 12.01 11.92 10.70 13/202 12646
/proc/meminfo: memFree=20313108/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631373926660571136 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=757668 CPUtime=334.09 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 120872 0 0 0 33371 38 0 0 25 0 1 0 489186947 775852032 8520 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238525 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 189417 8520 338 96 0 185979 0
[pid=12592] ppid=12590 vsize=40024 CPUtime=334.06 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 7087 0 0 0 33405 1 0 0 25 0 1 0 489186947 40984576 6932 33554432000 4194304 4785740 140735588910848 18446744073709551615 4287158 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 10006 6932 341 145 0 7051 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=334.14 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 33414 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134530793 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 1272896

[startup+1062.3 s]
/proc/loadavg: 12.00 11.94 10.78 13/202 12647
/proc/meminfo: memFree=20296836/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631373926660571136 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=758184 CPUtime=354.09 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 124682 0 0 0 35369 40 0 0 25 0 1 0 489186947 776380416 8757 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 189546 8757 338 96 0 186108 0
[pid=12592] ppid=12590 vsize=41148 CPUtime=354.06 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 7319 0 0 0 35405 1 0 0 25 0 1 0 489186947 42135552 7164 33554432000 4194304 4785740 140735588910848 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 10287 7164 341 145 0 7332 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=354.15 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 35415 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 1274536

[startup+1122.3 s]
/proc/loadavg: 12.00 11.94 10.85 13/202 12649
/proc/meminfo: memFree=20302524/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374064099524608 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=55756 CPUtime=374.08 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 128216 0 0 0 37367 41 0 0 25 0 1 0 489186947 57094144 8765 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 13939 8765 338 96 0 10501 0
[pid=12592] ppid=12590 vsize=42164 CPUtime=374.07 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 7548 0 0 0 37406 1 0 0 25 0 1 0 489186947 43175936 7393 33554432000 4194304 4785740 140735588910848 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 10541 7393 341 145 0 7586 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=374.15 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 37415 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 1122.3
Current children cumulated vsize (KiB) 573124

[startup+1182.3 s]
/proc/loadavg: 12.03 11.97 10.93 13/202 12650
/proc/meminfo: memFree=20300004/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374064099524608 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=55872 CPUtime=394.08 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 131976 0 0 0 39366 42 0 0 25 0 1 0 489186947 57212928 9086 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 13968 9086 338 96 0 10530 0
[pid=12592] ppid=12590 vsize=42608 CPUtime=394.07 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 7650 0 0 0 39406 1 0 0 25 0 1 0 489186947 43630592 7495 33554432000 4194304 4785740 140735588910848 18446744073709551615 4287011 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 10652 7495 341 145 0 7697 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=394.14 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 39414 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134529870 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 1182.29
Current children cumulated vsize (KiB) 573684

[startup+1242.3 s]
/proc/loadavg: 12.01 11.97 10.99 13/202 12652
/proc/meminfo: memFree=20280392/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374201538478080 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=56032 CPUtime=414.07 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 135667 0 0 0 41363 44 0 0 25 0 1 0 489186947 57376768 9050 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238654 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 14008 9050 338 96 0 10570 0
[pid=12592] ppid=12590 vsize=42820 CPUtime=414.08 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 7719 0 0 0 41407 1 0 0 25 0 1 0 489186947 43847680 7564 33554432000 4194304 4785740 140735588910848 18446744073709551615 4278087 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 10705 7564 341 145 0 7750 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=414.14 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 41414 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 1242.29
Current children cumulated vsize (KiB) 574056



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 11.76 11.92 11.04 7/189 12673
/proc/meminfo: memFree=20564644/32950904 swapFree=67082284/67111528
[pid=12590] ppid=12588 vsize=18324 CPUtime=0 cores=5,7
/proc/12590/stat : 12590 (ppfolio) S 12588 12590 11530 0 -1 4202496 499 0 0 0 0 0 0 0 15 0 1 0 489186947 18763776 394 33554432000 4194304 4287625 140734094961392 18446744073709551615 237278899727 0 0 4096 65536 5631374201538478080 0 0 17 7 0 0 0
/proc/12590/statm: 4581 394 345 23 0 91 0
[pid=12591] ppid=12590 vsize=56192 CPUtime=433.33 cores=5
/proc/12591/stat : 12591 (cryptominisat) R 12590 12590 11530 0 -1 4202496 139231 0 0 0 43287 46 0 0 25 0 1 0 489186947 57540608 8881 33554432000 4194304 4587354 140737160036080 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12591/statm: 14048 8881 338 96 0 10610 0
[pid=12592] ppid=12590 vsize=43284 CPUtime=433.35 cores=5
/proc/12592/stat : 12592 (clasp) R 12590 12590 11530 0 -1 4202496 7833 0 0 0 43334 1 0 0 25 0 1 0 489186947 44322816 7678 33554432000 4194304 4785740 140735588910848 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12592/statm: 10821 7678 341 145 0 7866 0
[pid=12593] ppid=12590 vsize=456880 CPUtime=433.34 cores=5
/proc/12593/stat : 12593 (TNM) R 12590 12590 11530 0 -1 4202496 675 0 0 0 43334 0 0 0 25 0 1 0 489186947 467845120 572 33554432000 134512640 134534564 4294648144 18446744073709551615 134530796 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12593/statm: 114220 572 95 6 0 112886 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 574680

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1300.01
CPU time (s): 1300.04
CPU user time (s): 1299.56
CPU system time (s): 0.487925
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 4659376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.56
system time used= 0.487925
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 148270
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 267
involuntary context switches= 26759

runsolver used 2.10168 second user time and 5.01224 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-26 01:57:52
IDJOB=3289951
IDBENCH=83412
IDSOLVER=1613
FILE ID=node121/3289951-1303775871
RUNJOBID= node121-1303774563-12396
PBS_JOBID= 13157167
Free space on /tmp= 72068 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_1_keyfind_1.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289951-1303775871/watcher-3289951-1303775871 -o /tmp/evaluation-result-3289951-1303775871/solver-3289951-1303775871 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3289951-1303775871.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 5092a9db644d53c7bc023e4dff206812
RANDOM SEED=500597999

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20843124 kB
Buffers:       2148604 kB
Cached:        9364812 kB
SwapCached:       2776 kB
Active:        8615664 kB
Inactive:      2980480 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20843124 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           32088 kB
Writeback:           0 kB
AnonPages:       80332 kB
Mapped:          16232 kB
Slab:           446484 kB
PageTables:       5836 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:  2882068 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72056 MiB
End job on node121 at 2011-04-26 02:19:32