Trace number 3273447

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300 1300.01

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n300-s12830984-sat.cnf
MD5SUM8561dcfb17af254a7261755a5f31a440
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark289.739
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses720
Sum of the clauses size1800
Maximum clause length5
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2600
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 5120
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 1

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273447-1303603558/watcher-3273447-1303603558 -o /tmp/evaluation-result-3273447-1303603558/solver-3273447-1303603558 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3273447-1303603558.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.69 3.95 3.73 6/182 18559
/proc/meminfo: memFree=14392660/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 497 0 0 0 0 0 0 0 23 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 12601841419817025800 0 0 17 1 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0

[startup+0.0984541 s]
/proc/loadavg: 3.69 3.95 3.73 6/182 18559
/proc/meminfo: memFree=14392660/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 25 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.809329 s]
/proc/loadavg: 3.69 3.95 3.73 6/182 18559
/proc/meminfo: memFree=14392660/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 23 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633823088811442176 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.900323 s]
/proc/loadavg: 3.69 3.95 3.73 6/182 18559
/proc/meminfo: memFree=14392660/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 23 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633823088811442176 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.00029 s]
/proc/loadavg: 3.69 3.95 3.73 6/182 18559
/proc/meminfo: memFree=14392660/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 23 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633823088811442176 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50022 s]
/proc/loadavg: 3.69 3.95 3.73 6/182 18559
/proc/meminfo: memFree=14392660/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 18 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633823226250395648 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10092 s]
/proc/loadavg: 4.36 4.09 3.78 13/202 18584
/proc/meminfo: memFree=14358912/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 18 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633823363689349120 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2084816 CPUtime=1.09 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 2370 0 0 0 109 0 0 0 25 0 1 0 471953793 2134851584 1042 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 521204 1042 327 96 0 517766 0
[pid=18566] ppid=18559 vsize=13220 CPUtime=0.94 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 776 0 0 0 94 0 0 0 25 0 1 0 471953793 13537280 666 33554432000 4194304 4785740 140736154965120 18446744073709551615 4550458 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 3305 666 340 145 0 350 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=1.04 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 104 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134528697 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 2572056

[startup+6.30036 s]
/proc/loadavg: 4.36 4.09 3.78 13/202 18584
/proc/meminfo: memFree=14328016/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633825012956790784 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2095444 CPUtime=2.11 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 5588 0 0 0 211 0 0 0 25 0 1 0 471953793 2145734656 3638 33554432000 4194304 4587354 140735366193168 18446744073709551615 4357555 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 523861 3638 337 96 0 520423 0
[pid=18566] ppid=18559 vsize=13620 CPUtime=2.04 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 882 0 0 0 204 0 0 0 25 0 1 0 471953793 13946880 772 33554432000 4194304 4785740 140736154965120 18446744073709551615 4562640 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 3405 772 340 145 0 450 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=2.12 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 212 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134528612 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 2583084

[startup+12.7012 s]
/proc/loadavg: 5.55 4.35 3.87 13/202 18644
/proc/meminfo: memFree=14324380/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633825012956790784 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2102356 CPUtime=4.29 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 8990 0 0 0 428 1 0 0 25 0 1 0 471953793 2152812544 5577 33554432000 4194304 4587354 140735366193168 18446744073709551615 4357665 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 525589 5577 337 96 0 522151 0
[pid=18566] ppid=18559 vsize=14288 CPUtime=4.14 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 1046 0 0 0 414 0 0 0 25 0 1 0 471953793 14630912 936 33554432000 4194304 4785740 140736154965120 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 3572 936 340 145 0 617 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=4.25 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 425 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134528558 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 2590664

[startup+25.501 s]
/proc/loadavg: 6.54 4.60 3.95 13/202 18675
/proc/meminfo: memFree=14307256/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633825012956790784 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2100512 CPUtime=8.51 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 12142 0 0 0 850 1 0 0 25 0 1 0 471953793 2150924288 6904 33554432000 4194304 4587354 140735366193168 18446744073709551615 4357656 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 525128 6904 337 96 0 521690 0
[pid=18566] ppid=18559 vsize=14952 CPUtime=8.44 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 1206 0 0 0 844 0 0 0 25 0 1 0 471953793 15310848 1096 33554432000 4194304 4785740 140736154965120 18446744073709551615 4550319 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 3738 1096 340 145 0 783 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=8.52 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 852 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134530438 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 2589484

[startup+51.1005 s]
/proc/loadavg: 8.40 5.19 4.17 13/202 18675
/proc/meminfo: memFree=14289164/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633823088811442176 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2108448 CPUtime=17.09 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 16515 0 0 0 1707 2 0 0 25 0 1 0 471953793 2159050752 8766 33554432000 4194304 4587354 140735366193168 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 527112 8766 337 96 0 523674 0
[pid=18566] ppid=18559 vsize=16052 CPUtime=16.94 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 1456 0 0 0 1694 0 0 0 25 0 1 0 471953793 16437248 1346 33554432000 4194304 4785740 140736154965120 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 4013 1346 340 145 0 1058 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=17.05 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 1705 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134528680 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 2598520

[startup+102.3 s]
/proc/loadavg: 10.56 6.34 4.61 13/202 18677
/proc/meminfo: memFree=14232636/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2129244 CPUtime=34.12 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 21120 0 0 0 3410 2 0 0 25 0 1 0 471953793 2180345856 11794 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238683 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 532311 11794 337 96 0 528873 0
[pid=18566] ppid=18559 vsize=17136 CPUtime=34.04 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 1740 0 0 0 3404 0 0 0 25 0 1 0 471953793 17547264 1630 33554432000 4194304 4785740 140736154965120 18446744073709551615 4287024 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 4284 1630 340 145 0 1329 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=34.11 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 3411 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134530401 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 2620400

[startup+162.301 s]
/proc/loadavg: 11.50 7.38 5.08 13/202 18678
/proc/meminfo: memFree=14211420/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633823913445163008 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2129520 CPUtime=54.14 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 25952 0 0 0 5411 3 0 0 25 0 1 0 471953793 2180628480 12983 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238525 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 532380 12983 337 96 0 528942 0
[pid=18566] ppid=18559 vsize=18084 CPUtime=54.03 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 1974 0 0 0 5403 0 0 0 25 0 1 0 471953793 18518016 1864 33554432000 4194304 4785740 140736154965120 18446744073709551615 4287143 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 4521 1864 340 145 0 1566 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=54.11 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 5411 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134528918 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 2621624

[startup+222.3 s]

################
# More data... #
################

/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 2658280

[startup+942.307 s]
/proc/loadavg: 12.00 11.66 9.00 13/202 18699
/proc/meminfo: memFree=14107100/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633824050884116480 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2162160 CPUtime=314.14 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 72459 0 0 0 31402 12 0 0 25 0 1 0 471953793 2214051840 20127 33554432000 4194304 4587354 140735366193168 18446744073709551615 4236384 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 540540 20127 337 96 0 537102 0
[pid=18566] ppid=18559 vsize=22484 CPUtime=313.99 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 2999 0 0 0 31399 0 0 0 25 0 1 0 471953793 23023616 2889 33554432000 4194304 4785740 140736154965120 18446744073709551615 4553399 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 5621 2889 340 145 0 2666 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=314.16 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 31416 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 942.29
Current children cumulated vsize (KiB) 2658664

[startup+1002.3 s]
/proc/loadavg: 12.00 11.72 9.18 13/202 18701
/proc/meminfo: memFree=14102612/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633824188323069952 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2162120 CPUtime=334.14 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 77463 0 0 0 33400 14 0 0 25 0 1 0 471953793 2214010880 21047 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 540530 21047 337 96 0 537092 0
[pid=18566] ppid=18559 vsize=22636 CPUtime=333.99 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 3047 0 0 0 33399 0 0 0 25 0 1 0 471953793 23179264 2937 33554432000 4194304 4785740 140736154965120 18446744073709551615 4416852 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 5659 2937 340 145 0 2704 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=334.16 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 33416 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134530796 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 2658776

[startup+1062.3 s]
/proc/loadavg: 12.00 11.77 9.36 13/202 18702
/proc/meminfo: memFree=14101832/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633824188323069952 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2162276 CPUtime=354.14 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 82051 0 0 0 35399 15 0 0 25 0 1 0 471953793 2214170624 21517 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238435 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 540569 21517 337 96 0 537131 0
[pid=18566] ppid=18559 vsize=22784 CPUtime=353.99 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 3067 0 0 0 35399 0 0 0 25 0 1 0 471953793 23330816 2957 33554432000 4194304 4785740 140736154965120 18446744073709551615 4552568 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 5696 2957 340 145 0 2741 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=354.17 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 35417 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134529823 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 2659080

[startup+1122.3 s]
/proc/loadavg: 12.00 11.81 9.52 13/202 18704
/proc/meminfo: memFree=14102556/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633824188323069952 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2162368 CPUtime=374.13 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 86534 0 0 0 37398 15 0 0 25 0 1 0 471953793 2214264832 21796 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 540592 21796 337 96 0 537154 0
[pid=18566] ppid=18559 vsize=22784 CPUtime=374 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 3094 0 0 0 37400 0 0 0 25 0 1 0 471953793 23330816 2984 33554432000 4194304 4785740 140736154965120 18446744073709551615 4546132 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 5696 2984 340 145 0 2741 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=374.16 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 37416 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 1122.29
Current children cumulated vsize (KiB) 2659172

[startup+1182.3 s]
/proc/loadavg: 12.00 11.84 9.67 13/202 18705
/proc/meminfo: memFree=14104504/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633824325762023424 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2162476 CPUtime=394.13 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 91188 0 0 0 39397 16 0 0 25 0 1 0 471953793 2214375424 22259 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 540619 22259 337 96 0 537181 0
[pid=18566] ppid=18559 vsize=22936 CPUtime=394.01 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 3103 0 0 0 39401 0 0 0 25 0 1 0 471953793 23486464 2993 33554432000 4194304 4785740 140736154965120 18446744073709551615 4549842 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 5734 2993 340 145 0 2779 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=394.16 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 39416 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 12253456 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 1182.3
Current children cumulated vsize (KiB) 2659432

[startup+1242.3 s]
/proc/loadavg: 12.00 11.87 9.81 13/202 18707
/proc/meminfo: memFree=14089108/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633824325762023424 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2162564 CPUtime=414.13 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 95763 0 0 0 41396 17 0 0 25 0 1 0 471953793 2214465536 22603 33554432000 4194304 4587354 140735366193168 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 540641 22603 337 96 0 537203 0
[pid=18566] ppid=18559 vsize=22936 CPUtime=414.01 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 3112 0 0 0 41401 0 0 0 25 0 1 0 471953793 23486464 3002 33554432000 4194304 4785740 140736154965120 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 5734 3002 340 145 0 2779 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=414.16 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 41416 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 1242.3
Current children cumulated vsize (KiB) 2659520



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.00 11.89 9.94 13/202 18709
/proc/meminfo: memFree=14091560/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633824325762023424 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2162764 CPUtime=433.38 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 101840 0 0 0 43320 18 0 0 25 0 1 0 471953793 2214670336 20031 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 540691 20031 337 96 0 537253 0
[pid=18566] ppid=18559 vsize=22936 CPUtime=433.27 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 3125 0 0 0 43327 0 0 0 25 0 1 0 471953793 23486464 3015 33554432000 4194304 4785740 140736154965120 18446744073709551615 4309545 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 5734 3015 340 145 0 2779 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=433.35 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 43335 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 12253575 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 1300
Current children cumulated vsize (KiB) 2659720

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 12.00 11.89 9.94 13/202 18709
/proc/meminfo: memFree=14091560/32951124 swapFree=67111524/67111528
[pid=18559] ppid=18557 vsize=18324 CPUtime=0 cores=1,3
/proc/18559/stat : 18559 (ppfolio) S 18557 18559 18201 0 -1 4202496 498 0 0 0 0 0 0 0 15 0 1 0 471953792 18763776 393 33554432000 4194304 4287625 140734529658560 18446744073709551615 228244368911 0 0 4096 65536 5633824325762023424 0 0 17 3 0 0 0
/proc/18559/statm: 4581 393 345 23 0 91 0
[pid=18565] ppid=18559 vsize=2162764 CPUtime=433.38 cores=1
/proc/18565/stat : 18565 (cryptominisat) R 18559 18559 18201 0 -1 4202496 101840 0 0 0 43320 18 0 0 25 0 1 0 471953793 2214670336 20031 33554432000 4194304 4587354 140735366193168 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/18565/statm: 540691 20031 337 96 0 537253 0
[pid=18566] ppid=18559 vsize=22936 CPUtime=433.27 cores=1
/proc/18566/stat : 18566 (clasp) R 18559 18559 18201 0 -1 4202496 3125 0 0 0 43327 0 0 0 25 0 1 0 471953793 23486464 3015 33554432000 4194304 4785740 140736154965120 18446744073709551615 4309545 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18566/statm: 5734 3015 340 145 0 2779 0
[pid=18568] ppid=18559 vsize=455696 CPUtime=433.35 cores=1
/proc/18568/stat : 18568 (TNM) R 18559 18559 18201 0 -1 4202496 289 0 0 0 43335 0 0 0 25 0 1 0 471953793 466632704 186 33554432000 134512640 134534564 4290278304 18446744073709551615 12253575 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/18568/statm: 113924 186 95 6 0 112590 0
Current children cumulated CPU time (s) 1300
Current children cumulated vsize (KiB) 2659720

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18559 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.002998
# while last known CPU time is 1300
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300
CPU user time (s): 1299.82
CPU system time (s): 0.18
CPU usage (%): 99.9989
Max. virtual memory (cumulated for all children) (KiB): 4733336

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 498
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 153
involuntary context switches= 4

runsolver used 2.11968 second user time and 4.97924 second system time

The end

Launcher Data 

Begin job on node136 at 2011-04-24 02:05:58
IDJOB=3273447
IDBENCH=83139
IDSOLVER=1613
FILE ID=node136/3273447-1303603558
RUNJOBID= node136-1303603558-18531
PBS_JOBID= 13150606
Free space on /tmp= 71612 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n300-s12830984-sat.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273447-1303603558/watcher-3273447-1303603558 -o /tmp/evaluation-result-3273447-1303603558/solver-3273447-1303603558 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3273447-1303603558.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 8561dcfb17af254a7261755a5f31a440
RANDOM SEED=183943944

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14393064 kB
Buffers:       1701620 kB
Cached:       16224732 kB
SwapCached:          4 kB
Active:        9473236 kB
Inactive:      8518396 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14393064 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           30316 kB
Writeback:           0 kB
AnonPages:       65300 kB
Mapped:          16036 kB
Slab:           502472 kB
PageTables:       5580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   669028 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71584 MiB
End job on node136 at 2011-04-24 02:27:40