Trace number 3289168

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.32 1201.71

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top24.cnf
MD5SUM1f485d737caaaca49e2c467c83cbdcec
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark520.047
Satisfiable
(Un)Satisfiability was proved
Number of variables65983
Number of clauses209942
Sum of the clauses size513194
Maximum clause length2578
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2127592
Number of clauses of size 380970
Number of clauses of size 4299
Number of clauses of size 522
Number of clauses of size over 51058

Solver Data 

0.00/0.02	This is pico-portfolio, a naive parallel portfolio
0.00/0.02	Copyright (C) 2011 Olivier Roussel
0.00/0.02	Using 4 processing units
0.00/0.02	This portfolio uses the following solvers:
0.00/0.02	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.02	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.02	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.02	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.02	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.02	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.02	Starting clasp 1.3.6 on core(s) 5
0.00/0.02	Starting TNM 2009 on core(s) 7
0.00/0.02	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.02	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289168-1304080824/watcher-3289168-1304080824 -o /tmp/evaluation-result-3289168-1304080824/solver-3289168-1304080824 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3289168-1304080824.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.14 8.25 8.72 6/181 1286
/proc/meminfo: memFree=20226008/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=2712 CPUtime=0 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) R 1284 1286 567 0 -1 4194304 83 0 0 0 0 0 0 0 25 0 1 0 598313100 2777088 36 33554432000 4194304 4287625 140733890056736 18446744073709551615 231890566791 0 2147483391 4096 0 0 0 0 17 1 0 0 0
/proc/1286/statm: 678 36 27 23 0 23 0

[startup+0.043453 s]
/proc/loadavg: 8.14 8.25 8.72 6/181 1286
/proc/meminfo: memFree=20226008/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) R 1284 1286 567 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 598313100 18763776 389 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/1286/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100444 s]
/proc/loadavg: 8.14 8.25 8.72 6/181 1286
/proc/meminfo: memFree=20226008/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) R 1284 1286 567 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 598313100 18763776 389 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/1286/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300406 s]
/proc/loadavg: 8.14 8.25 8.72 6/181 1286
/proc/meminfo: memFree=20226008/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) R 1284 1286 567 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 598313100 18763776 389 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/1286/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700336 s]
/proc/loadavg: 8.14 8.25 8.72 6/181 1286
/proc/meminfo: memFree=20226008/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) R 1284 1286 567 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 598313100 18763776 389 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/1286/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50119 s]
/proc/loadavg: 8.14 8.25 8.72 9/186 1292
/proc/meminfo: memFree=20117468/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 17 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=58712 CPUtime=1.49 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 9412 0 0 0 148 1 0 0 20 0 1 0 598313101 60121088 9137 33554432000 4194304 4587354 140736084580016 18446744073709551615 4367364 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 14678 9137 312 96 0 11240 0
[pid=1289] ppid=1286 vsize=47844 CPUtime=1.49 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 11578 0 0 0 147 2 0 0 25 0 1 0 598313101 48992256 9039 33554432000 4194304 4785740 140735284165824 18446744073709551615 4553071 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 11961 9039 340 145 0 9006 0
[pid=1291] ppid=1286 vsize=18672 CPUtime=1.49 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 8570 0 0 0 148 1 0 0 25 0 1 0 598313101 19120128 3822 33554432000 4194304 4352236 140736797408368 18446744073709551615 4319146 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 4668 3822 119 39 0 3748 0
[pid=1292] ppid=1286 vsize=50320 CPUtime=1.46 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 61668 0 0 0 138 8 0 0 25 0 1 0 598313101 51527680 9119 33554432000 4194304 4331988 140735995978592 18446744073709551615 4253911 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 12580 9119 152 34 0 11022 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 193872

[startup+3.10088 s]
/proc/loadavg: 8.13 8.25 8.71 9/186 1292
/proc/meminfo: memFree=20058568/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195738567704576 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=82824 CPUtime=3.09 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 18910 0 0 0 307 2 0 0 25 0 1 0 598313101 84811776 15736 33554432000 4194304 4587354 140736084580016 18446744073709551615 4236622 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 20706 15736 330 96 0 17268 0
[pid=1289] ppid=1286 vsize=47844 CPUtime=3.09 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 11587 0 0 0 307 2 0 0 25 0 1 0 598313101 48992256 9048 33554432000 4194304 4785740 140735284165824 18446744073709551615 4546132 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 11961 9048 340 145 0 9006 0
[pid=1291] ppid=1286 vsize=26308 CPUtime=3.08 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 10491 0 0 0 307 1 0 0 25 0 1 0 598313101 26939392 5743 33554432000 4194304 4352236 140736797408368 18446744073709551615 4214782 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 6577 5743 125 39 0 5657 0
[pid=1292] ppid=1286 vsize=148804 CPUtime=3.05 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 80377 0 0 0 295 10 0 0 25 0 1 0 598313101 152375296 19134 33554432000 4194304 4331988 140735995978592 18446744073709551615 4237136 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 37201 19134 176 34 0 35643 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 324104

[startup+6.30028 s]
/proc/loadavg: 8.13 8.25 8.71 9/186 1292
/proc/meminfo: memFree=20009760/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=120328 CPUtime=6.28 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 19656 0 0 0 626 2 0 0 25 0 1 0 598313101 123215872 16469 33554432000 4194304 4587354 140736084580016 18446744073709551615 4241265 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 30082 16469 330 96 0 26644 0
[pid=1289] ppid=1286 vsize=51648 CPUtime=6.28 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 12569 0 0 0 626 2 0 0 25 0 1 0 598313101 52887552 10030 33554432000 4194304 4785740 140735284165824 18446744073709551615 4287158 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 12912 10030 340 145 0 9957 0
[pid=1291] ppid=1286 vsize=26308 CPUtime=6.28 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 10491 0 0 0 627 1 0 0 25 0 1 0 598313101 26939392 5743 33554432000 4194304 4352236 140736797408368 18446744073709551615 4208160 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 6577 5743 125 39 0 5657 0
[pid=1292] ppid=1286 vsize=156204 CPUtime=6.24 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 81874 0 0 0 613 11 0 0 25 0 1 0 598313101 159952896 20630 33554432000 4194304 4331988 140735995978592 18446744073709551615 4265493 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 39051 20630 175 34 0 37493 0
Current children cumulated CPU time (s) 25.09
Current children cumulated vsize (KiB) 372812

[startup+12.7011 s]
/proc/loadavg: 8.11 8.24 8.71 9/186 1292
/proc/meminfo: memFree=19978668/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=120328 CPUtime=12.68 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 20006 0 0 0 1266 2 0 0 25 0 1 0 598313101 123215872 16809 33554432000 4194304 4587354 140736084580016 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 30082 16809 336 96 0 26644 0
[pid=1289] ppid=1286 vsize=61364 CPUtime=12.69 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 14917 0 0 0 1266 3 0 0 25 0 1 0 598313101 62836736 12378 33554432000 4194304 4785740 140735284165824 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 15341 12378 340 145 0 12386 0
[pid=1291] ppid=1286 vsize=26308 CPUtime=12.69 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 10491 0 0 0 1268 1 0 0 25 0 1 0 598313101 26939392 5743 33554432000 4194304 4352236 140736797408368 18446744073709551615 4207627 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 6577 5743 125 39 0 5657 0
[pid=1292] ppid=1286 vsize=157292 CPUtime=12.6 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 82231 0 0 0 1249 11 0 0 25 0 1 0 598313101 161067008 20987 33554432000 4194304 4331988 140735995978592 18446744073709551615 4263143 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 39323 20987 175 34 0 37765 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 383616

[startup+25.5007 s]
/proc/loadavg: 8.09 8.23 8.70 9/186 1293
/proc/meminfo: memFree=19957400/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=491124 CPUtime=25.49 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 29814 0 0 0 2544 5 0 0 25 0 1 0 598313101 502910976 17846 33554432000 4194304 4587354 140736084580016 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 122781 17846 336 96 0 119343 0
[pid=1289] ppid=1286 vsize=65616 CPUtime=25.48 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 15895 0 0 0 2545 3 0 0 25 0 1 0 598313101 67190784 13356 33554432000 4194304 4785740 140735284165824 18446744073709551615 4553088 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 16404 13356 340 145 0 13449 0
[pid=1291] ppid=1286 vsize=22048 CPUtime=25.48 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 10493 0 0 0 2547 1 0 0 25 0 1 0 598313101 22577152 4680 33554432000 4194304 4352236 140736797408368 18446744073709551615 4329024 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 5512 4680 127 39 0 4592 0
[pid=1292] ppid=1286 vsize=157888 CPUtime=25.33 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 82370 0 0 0 2522 11 0 0 25 0 1 0 598313101 161677312 21126 33554432000 4194304 4331988 140735995978592 18446744073709551615 4265733 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 39472 21126 175 34 0 37914 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 755000

[startup+51.1009 s]
/proc/loadavg: 8.12 8.23 8.68 9/186 1293
/proc/meminfo: memFree=19912968/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=483972 CPUtime=51.08 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 40275 0 0 0 5100 8 0 0 25 0 1 0 598313101 495587328 20019 33554432000 4194304 4587354 140736084580016 18446744073709551615 4238538 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 120993 20019 336 96 0 117555 0
[pid=1289] ppid=1286 vsize=79152 CPUtime=51.09 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 19268 0 0 0 5104 5 0 0 25 0 1 0 598313101 81051648 16729 33554432000 4194304 4785740 140735284165824 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 19788 16729 340 145 0 16833 0
[pid=1291] ppid=1286 vsize=26136 CPUtime=51.08 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 13565 0 0 0 5107 1 0 0 25 0 1 0 598313101 26763264 5702 33554432000 4194304 4352236 140736797408368 18446744073709551615 4276741 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 6534 5702 127 39 0 5614 0
[pid=1292] ppid=1286 vsize=158292 CPUtime=50.79 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 82471 0 0 0 5068 11 0 0 25 0 1 0 598313101 162091008 21227 33554432000 4194304 4331988 140735995978592 18446744073709551615 231894885441 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 39573 21227 175 34 0 38015 0
Current children cumulated CPU time (s) 204.05
Current children cumulated vsize (KiB) 765876

[startup+102.307 s]
/proc/loadavg: 8.10 8.20 8.65 9/186 1295
/proc/meminfo: memFree=19861716/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=542356 CPUtime=102.29 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 53312 0 0 0 10218 11 0 0 25 0 1 0 598313101 555372544 26910 33554432000 4194304 4587354 140736084580016 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 135589 26910 336 96 0 132151 0
[pid=1289] ppid=1286 vsize=96476 CPUtime=102.29 cores=5

################
# More data... #
################


[startup+942.301 s]
/proc/loadavg: 8.11 8.10 8.29 9/186 1350
/proc/meminfo: memFree=19872124/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=555204 CPUtime=942.31 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 170787 0 0 0 94165 66 0 0 25 0 1 0 598313101 568528896 35212 33554432000 4194304 4587354 140736084580016 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 138801 35212 336 96 0 135363 0
[pid=1289] ppid=1286 vsize=202008 CPUtime=942.32 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 48931 0 0 0 94212 20 0 0 25 0 1 0 598313101 206856192 46392 33554432000 4194304 4785740 140735284165824 18446744073709551615 4552630 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 50502 46392 340 145 0 47547 0
[pid=1291] ppid=1286 vsize=58436 CPUtime=942.32 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 54410 0 0 0 94226 6 0 0 25 0 1 0 598313101 59838464 13777 33554432000 4194304 4352236 140736797408368 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 14609 13777 127 39 0 13689 0
[pid=1292] ppid=1286 vsize=164588 CPUtime=937.14 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 83816 0 0 0 93703 11 0 0 25 0 1 0 598313101 168538112 22572 33554432000 4194304 4331988 140735995978592 18446744073709551615 4228605 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 41147 22572 175 34 0 39589 0
Current children cumulated CPU time (s) 3764.1
Current children cumulated vsize (KiB) 998560

[startup+1002.3 s]
/proc/loadavg: 8.10 8.09 8.27 9/186 1352
/proc/meminfo: memFree=19871980/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=560580 CPUtime=1002.32 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 172755 0 0 0 100164 68 0 0 25 0 1 0 598313101 574033920 35212 33554432000 4194304 4587354 140736084580016 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 140145 35212 336 96 0 136707 0
[pid=1289] ppid=1286 vsize=202008 CPUtime=1002.32 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 48952 0 0 0 100212 20 0 0 25 0 1 0 598313101 206856192 46413 33554432000 4194304 4785740 140735284165824 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 50502 46413 340 145 0 47547 0
[pid=1291] ppid=1286 vsize=58436 CPUtime=1002.32 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 54922 0 0 0 100226 6 0 0 25 0 1 0 598313101 59838464 13777 33554432000 4194304 4352236 140736797408368 18446744073709551615 4328239 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 14609 13777 127 39 0 13689 0
[pid=1292] ppid=1286 vsize=164588 CPUtime=996.81 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 83850 0 0 0 99670 11 0 0 25 0 1 0 598313101 168538112 22606 33554432000 4194304 4331988 140735995978592 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 41147 22606 175 34 0 39589 0
Current children cumulated CPU time (s) 4003.78
Current children cumulated vsize (KiB) 1003936

[startup+1062.3 s]
/proc/loadavg: 8.09 8.09 8.26 9/186 1353
/proc/meminfo: memFree=19855204/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=562900 CPUtime=1062.31 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 175263 0 0 0 106163 68 0 0 25 0 1 0 598313101 576409600 36458 33554432000 4194304 4587354 140736084580016 18446744073709551615 4231923 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 140725 36458 336 96 0 137287 0
[pid=1289] ppid=1286 vsize=203848 CPUtime=1062.32 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 49387 0 0 0 106212 20 0 0 25 0 1 0 598313101 208740352 46848 33554432000 4194304 4785740 140735284165824 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 50962 46848 340 145 0 48007 0
[pid=1291] ppid=1286 vsize=58436 CPUtime=1062.32 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 55434 0 0 0 106226 6 0 0 25 0 1 0 598313101 59838464 13777 33554432000 4194304 4352236 140736797408368 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 14609 13777 127 39 0 13689 0
[pid=1292] ppid=1286 vsize=164588 CPUtime=1056.48 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 83888 0 0 0 105637 11 0 0 25 0 1 0 598313101 168538112 22644 33554432000 4194304 4331988 140735995978592 18446744073709551615 4265477 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 41147 22644 175 34 0 39589 0
Current children cumulated CPU time (s) 4243.44
Current children cumulated vsize (KiB) 1008096

[startup+1122.3 s]
/proc/loadavg: 8.13 8.10 8.25 9/186 1355
/proc/meminfo: memFree=19837456/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=586808 CPUtime=1122.32 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 176470 0 0 0 112163 69 0 0 25 0 1 0 598313101 600891392 35236 33554432000 4194304 4587354 140736084580016 18446744073709551615 4238958 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 146702 35236 336 96 0 143264 0
[pid=1289] ppid=1286 vsize=204592 CPUtime=1122.32 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 49559 0 0 0 112212 20 0 0 25 0 1 0 598313101 209502208 47020 33554432000 4194304 4785740 140735284165824 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 51148 47020 340 145 0 48193 0
[pid=1291] ppid=1286 vsize=61512 CPUtime=1122.32 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 57483 0 0 0 112226 6 0 0 25 0 1 0 598313101 62988288 14546 33554432000 4194304 4352236 140736797408368 18446744073709551615 4329176 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 15378 14546 127 39 0 14458 0
[pid=1292] ppid=1286 vsize=164588 CPUtime=1116.16 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 83927 0 0 0 111605 11 0 0 25 0 1 0 598313101 168538112 22683 33554432000 4194304 4331988 140735995978592 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 41147 22683 175 34 0 39589 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 1035824

[startup+1182.3 s]
/proc/loadavg: 8.09 8.09 8.24 9/186 1357
/proc/meminfo: memFree=19820936/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=547980 CPUtime=1182.32 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 178204 0 0 0 118161 71 0 0 25 0 1 0 598313101 561131520 35212 33554432000 4194304 4587354 140736084580016 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 136995 35212 336 96 0 133557 0
[pid=1289] ppid=1286 vsize=220124 CPUtime=1182.33 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 53372 0 0 0 118209 24 0 0 25 0 1 0 598313101 225406976 50833 33554432000 4194304 4785740 140735284165824 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 55031 50833 340 145 0 52076 0
[pid=1291] ppid=1286 vsize=61512 CPUtime=1182.33 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 60043 0 0 0 118226 7 0 0 25 0 1 0 598313101 62988288 14546 33554432000 4194304 4352236 140736797408368 18446744073709551615 4329060 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 15378 14546 127 39 0 14458 0
[pid=1292] ppid=1286 vsize=164588 CPUtime=1175.83 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 83967 0 0 0 117572 11 0 0 25 0 1 0 598313101 168538112 22723 33554432000 4194304 4331988 140735995978592 18446744073709551615 4242575 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 41147 22723 175 34 0 39589 0
Current children cumulated CPU time (s) 4722.82
Current children cumulated vsize (KiB) 1012528



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.14 8.10 8.24 9/186 1357
/proc/meminfo: memFree=19821180/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=549084 CPUtime=1201.73 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 179642 0 0 0 120101 72 0 0 25 0 1 0 598313101 562262016 35212 33554432000 4194304 4587354 140736084580016 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 137271 35212 336 96 0 133833 0
[pid=1289] ppid=1286 vsize=220124 CPUtime=1201.73 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 53378 0 0 0 120149 24 0 0 25 0 1 0 598313101 225406976 50839 33554432000 4194304 4785740 140735284165824 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 55031 50839 340 145 0 52076 0
[pid=1291] ppid=1286 vsize=59464 CPUtime=1201.73 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 60043 0 0 0 120166 7 0 0 25 0 1 0 598313101 60891136 14034 33554432000 4194304 4352236 140736797408368 18446744073709551615 4328016 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 14866 14034 127 39 0 13946 0
[pid=1292] ppid=1286 vsize=164588 CPUtime=1195.12 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 83981 0 0 0 119501 11 0 0 25 0 1 0 598313101 168538112 22737 33554432000 4194304 4331988 140735995978592 18446744073709551615 4263258 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 41147 22737 175 34 0 39589 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 1011584

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.14 8.10 8.24 9/186 1357
/proc/meminfo: memFree=19821180/32950928 swapFree=67111524/67111528
[pid=1286] ppid=1284 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1286/stat : 1286 (ppfolio) S 1284 1286 567 0 -1 4202496 524 1193 0 0 0 0 0 1 15 0 1 0 598313100 18763776 390 33554432000 4194304 4287625 140733890056736 18446744073709551615 231895510543 0 0 4096 65536 9224195742862639364 0 0 17 1 0 0 0
/proc/1286/statm: 4581 390 342 23 0 91 0
[pid=1287] ppid=1286 vsize=549084 CPUtime=1201.73 cores=1
/proc/1287/stat : 1287 (cryptominisat) R 1286 1286 567 0 -1 4202496 179642 0 0 0 120101 72 0 0 25 0 1 0 598313101 562262016 35212 33554432000 4194304 4587354 140736084580016 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1287/statm: 137271 35212 336 96 0 133833 0
[pid=1289] ppid=1286 vsize=220124 CPUtime=1201.73 cores=5
/proc/1289/stat : 1289 (clasp) R 1286 1286 567 0 -1 4202496 53378 0 0 0 120149 24 0 0 25 0 1 0 598313101 225406976 50839 33554432000 4194304 4785740 140735284165824 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1289/statm: 55031 50839 340 145 0 52076 0
[pid=1291] ppid=1286 vsize=59464 CPUtime=1201.73 cores=3
/proc/1291/stat : 1291 (lingeling) R 1286 1286 567 0 -1 4202496 60043 0 0 0 120166 7 0 0 25 0 1 0 598313101 60891136 14034 33554432000 4194304 4352236 140736797408368 18446744073709551615 4328016 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1291/statm: 14866 14034 127 39 0 13946 0
[pid=1292] ppid=1286 vsize=164588 CPUtime=1195.12 cores=7
/proc/1292/stat : 1292 (march_hi) R 1286 1286 567 0 -1 4202496 83981 0 0 0 119501 11 0 0 25 0 1 0 598313101 168538112 22737 33554432000 4194304 4331988 140735995978592 18446744073709551615 4263258 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1292/statm: 41147 22737 175 34 0 39589 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 1011584

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1286 and gives
#  childrusage.ru_utime.tv_sec=1201
#  childrusage.ru_utime.tv_usec=670318
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=96985
# CPU time returned by wait4() is 1201.77
# while last known CPU time is 4800.32
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.32
CPU user time (s): 4799.17
CPU system time (s): 1.15
CPU usage (%): 399.457
Max. virtual memory (cumulated for all children) (KiB): 1500528

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1201.67
system time used= 0.096985
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 61761
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 307
involuntary context switches= 3222

runsolver used 1.86871 second user time and 4.69629 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 14:40:24
IDJOB=3289168
IDBENCH=83116
IDSOLVER=1612
FILE ID=node114/3289168-1304080824
RUNJOBID= node114-1304077601-586
PBS_JOBID= 13170509
Free space on /tmp= 71784 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top24.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289168-1304080824/watcher-3289168-1304080824 -o /tmp/evaluation-result-3289168-1304080824/solver-3289168-1304080824 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3289168-1304080824.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1f485d737caaaca49e2c467c83cbdcec
RANDOM SEED=173849192

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20226288 kB
Buffers:       2222292 kB
Cached:        9360628 kB
SwapCached:          4 kB
Active:        3339440 kB
Inactive:      8803792 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20226288 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           13640 kB
Writeback:           0 kB
AnonPages:      560168 kB
Mapped:          16340 kB
Slab:           515952 kB
PageTables:       5608 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1471752 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71768 MiB
End job on node114 at 2011-04-29 15:00:28