Trace number 3262833

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.34 1201.72

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_27_50_3-dir.shuffled-as.sat03-169.cnf
MD5SUMb5a637600c242725f15a247a84bdea1b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables810
Number of clauses68270
Sum of the clauses size137296
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 268243
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 527

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262833-1304090179/watcher-3262833-1304090179 -o /tmp/evaluation-result-3262833-1304090179/solver-3262833-1304090179 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3262833-1304090179.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.36 10.23 8.86 1/180 2077
/proc/meminfo: memFree=30805884/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) R 2075 2077 379 0 -1 4194304 457 0 0 0 0 0 0 0 24 0 1 0 520615804 18763776 386 33554432000 4194304 4287625 140737158705744 18446744073709551615 4261303 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/2077/statm: 4581 387 339 23 0 91 0

[startup+1.03724 s]
/proc/loadavg: 10.36 10.23 8.86 1/180 2077
/proc/meminfo: memFree=30805884/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 21 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.13722 s]
/proc/loadavg: 10.36 10.23 8.86 1/180 2077
/proc/meminfo: memFree=30805884/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 21 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.20021 s]
/proc/loadavg: 10.36 10.23 8.86 1/180 2077
/proc/meminfo: memFree=30805884/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 21 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.33719 s]
/proc/loadavg: 10.36 10.23 8.86 1/180 2077
/proc/meminfo: memFree=30805884/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 21 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.53715 s]
/proc/loadavg: 10.36 10.23 8.86 1/180 2077
/proc/meminfo: memFree=30805884/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 21 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10087 s]
/proc/loadavg: 10.36 10.23 8.86 12/191 2115
/proc/meminfo: memFree=30722804/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1570960 CPUtime=3.09 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 6072 0 0 0 308 1 0 0 25 0 1 0 520615804 1608663040 3726 33554432000 4194304 4587354 140735913840976 18446744073709551615 4365216 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 392740 3726 337 96 0 389302 0
[pid=2079] ppid=2077 vsize=29820 CPUtime=3.09 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 5332 0 0 0 309 0 0 0 25 0 1 0 520615804 30535680 4791 33554432000 4194304 4785740 140734653060656 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 7455 4791 340 145 0 4500 0
[pid=2080] ppid=2077 vsize=455560 CPUtime=1.12 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1836 0 0 0 112 0 0 0 25 0 1 0 520615804 466493440 1733 33554432000 134512640 134534564 4293049808 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 113890 1733 95 6 0 112556 0
[pid=2081] ppid=2077 vsize=11336 CPUtime=3.09 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 2295 0 0 0 309 0 0 0 25 0 1 0 520615804 11608064 1933 33554432000 4194304 4352236 140735646844112 18446744073709551615 4276530 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 2834 1933 127 39 0 1914 0
[pid=2082] ppid=2077 vsize=17180 CPUtime=1.96 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 2101 0 0 0 196 0 0 0 21 0 1 0 520615804 17592320 1793 33554432000 4194304 4331988 140733525081632 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 4295 1793 174 34 0 2737 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 2103180

[startup+6.30129 s]
/proc/loadavg: 10.33 10.23 8.87 11/192 2116
/proc/meminfo: memFree=30688272/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1590612 CPUtime=6.29 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 10916 0 0 0 628 1 0 0 25 0 1 0 520615804 1628786688 8567 33554432000 4194304 4587354 140735913840976 18446744073709551615 4238668 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 397653 8567 337 96 0 394215 0
[pid=2079] ppid=2077 vsize=35764 CPUtime=6.29 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 6772 0 0 0 629 0 0 0 25 0 1 0 520615804 36622336 6231 33554432000 4194304 4785740 140734653060656 18446744073709551615 4286964 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 8941 6231 340 145 0 5986 0
[pid=2080] ppid=2077 vsize=455560 CPUtime=2.72 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1836 0 0 0 272 0 0 0 25 0 1 0 520615804 466493440 1733 33554432000 134512640 134534564 4293049808 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 113890 1733 95 6 0 112556 0
[pid=2081] ppid=2077 vsize=13640 CPUtime=6.29 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 3446 0 0 0 629 0 0 0 25 0 1 0 520615804 13967360 2572 33554432000 4194304 4352236 140735646844112 18446744073709551615 4328321 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 3410 2572 127 39 0 2490 0
[pid=2082] ppid=2077 vsize=17180 CPUtime=3.54 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 2114 0 0 0 354 0 0 0 25 0 1 0 520615804 17592320 1806 33554432000 4194304 4331988 140733525081632 18446744073709551615 4226184 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 4295 1806 174 34 0 2737 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 2131080

[startup+12.7011 s]
/proc/loadavg: 10.30 10.22 8.87 11/192 2116
/proc/meminfo: memFree=30658420/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1592296 CPUtime=12.69 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 18993 0 0 0 1267 2 0 0 25 0 1 0 520615804 1630511104 15285 33554432000 4194304 4587354 140735913840976 18446744073709551615 4357632 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 398074 15285 337 96 0 394636 0
[pid=2079] ppid=2077 vsize=42328 CPUtime=12.69 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 8351 0 0 0 1268 1 0 0 25 0 1 0 520615804 43343872 7810 33554432000 4194304 4785740 140734653060656 18446744073709551615 4287194 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 10582 7810 340 145 0 7627 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=5.92 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 592 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=15944 CPUtime=12.69 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 5046 0 0 0 1269 0 0 0 25 0 1 0 520615804 16326656 3148 33554432000 4194304 4352236 140735646844112 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 3986 3148 127 39 0 3066 0
[pid=2082] ppid=2077 vsize=17736 CPUtime=6.7 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 2145 0 0 0 670 0 0 0 25 0 1 0 520615804 18161664 1837 33554432000 4194304 4331988 140733525081632 18446744073709551615 4226201 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 4434 1837 174 34 0 2876 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 2146020

[startup+25.5008 s]
/proc/loadavg: 10.23 10.21 8.89 11/192 2116
/proc/meminfo: memFree=30591128/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1606968 CPUtime=25.49 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 20629 0 0 0 2547 2 0 0 25 0 1 0 520615804 1645535232 16918 33554432000 4194304 4587354 140735913840976 18446744073709551615 4238778 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 401742 16918 337 96 0 398304 0
[pid=2079] ppid=2077 vsize=52328 CPUtime=25.48 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 10696 0 0 0 2547 1 0 0 25 0 1 0 520615804 53583872 10155 33554432000 4194304 4785740 140734653060656 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 13082 10155 340 145 0 10127 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=12.25 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 1225 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=21068 CPUtime=25.48 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 7351 0 0 0 2548 0 0 0 25 0 1 0 520615804 21573632 4429 33554432000 4194304 4352236 140735646844112 18446744073709551615 4329328 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 5267 4429 127 39 0 4347 0
[pid=2082] ppid=2077 vsize=18760 CPUtime=13.1 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 2381 0 0 0 1310 0 0 0 25 0 1 0 520615804 19210240 2073 33554432000 4194304 4331988 140733525081632 18446744073709551615 4228307 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 4690 2073 175 34 0 3132 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 2176840

[startup+51.1011 s]
/proc/loadavg: 10.29 10.22 8.93 12/192 2117
/proc/meminfo: memFree=30560708/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1603004 CPUtime=51.09 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 26054 0 0 0 5105 4 0 0 25 0 1 0 520615804 1641476096 17890 33554432000 4194304 4587354 140735913840976 18446744073709551615 4238452 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 400751 17890 337 96 0 397313 0
[pid=2079] ppid=2077 vsize=62556 CPUtime=51.09 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 13025 0 0 0 5107 2 0 0 25 0 1 0 520615804 64057344 12484 33554432000 4194304 4785740 140734653060656 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 15639 12484 340 145 0 12684 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=25.01 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 2501 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=31312 CPUtime=51.09 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 10936 0 0 0 5108 1 0 0 25 0 1 0 520615804 32063488 6990 33554432000 4194304 4352236 140735646844112 18446744073709551615 4329300 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 7828 6990 127 39 0 6908 0
[pid=2082] ppid=2077 vsize=20036 CPUtime=25.8 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 2766 0 0 0 2580 0 0 0 25 0 1 0 520615804 20516864 2458 33554432000 4194304 4331988 140733525081632 18446744073709551615 4226474 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 5009 2458 175 34 0 3451 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 2194624

[startup+102.301 s]
/proc/loadavg: 10.38 10.25 9.01 12/192 2118
/proc/meminfo: memFree=30502028/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1622720 CPUtime=102.29 cores=1

################
# More data... #
################

/proc/2082/statm: 20961 16161 175 34 0 19403 0
Current children cumulated CPU time (s) 3764.13
Current children cumulated vsize (KiB) 2465336

[startup+1002.3 s]
/proc/loadavg: 10.21 10.28 9.80 11/192 2142
/proc/meminfo: memFree=30238216/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=3962716 CPUtime=1002.31 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 84183 0 0 0 100202 29 0 0 25 0 1 0 520615804 4057821184 38366 33554432000 4194304 4587354 140735913840976 18446744073709551615 4238552 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 990679 38366 337 96 0 987241 0
[pid=2079] ppid=2077 vsize=143624 CPUtime=1002.31 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 31892 0 0 0 100224 7 0 0 25 0 1 0 520615804 147070976 31351 33554432000 4194304 4785740 140734653060656 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 35906 31351 340 145 0 32951 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=498.03 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 49803 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134528710 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=64884 CPUtime=1002.31 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 199745 0 0 0 100205 26 0 0 25 0 1 0 520615804 66441216 15415 33554432000 4194304 4352236 140735646844112 18446744073709551615 4328022 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 16221 15415 127 39 0 15301 0
[pid=2082] ppid=2077 vsize=83844 CPUtime=498.82 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 17645 0 0 0 49873 9 0 0 25 0 1 0 520615804 85856256 17337 33554432000 4194304 4331988 140733525081632 18446744073709551615 4284354 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 20961 17337 175 34 0 19403 0
Current children cumulated CPU time (s) 4003.78
Current children cumulated vsize (KiB) 4732784

[startup+1062.3 s]
/proc/loadavg: 10.32 10.29 9.83 11/192 2144
/proc/meminfo: memFree=30216220/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=3962716 CPUtime=1062.31 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 88827 0 0 0 106199 32 0 0 25 0 1 0 520615804 4057821184 38366 33554432000 4194304 4587354 140735913840976 18446744073709551615 4357656 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 990679 38366 337 96 0 987241 0
[pid=2079] ppid=2077 vsize=150404 CPUtime=1062.31 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 33460 0 0 0 106224 7 0 0 25 0 1 0 520615804 154013696 32919 33554432000 4194304 4785740 140734653060656 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 37601 32919 340 145 0 34646 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=527.84 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 52784 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=73588 CPUtime=1062.32 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 207745 0 0 0 106205 27 0 0 25 0 1 0 520615804 75354112 17591 33554432000 4194304 4352236 140735646844112 18446744073709551615 4328191 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 18397 17591 127 39 0 17477 0
[pid=2082] ppid=2077 vsize=113312 CPUtime=528.68 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 18880 0 0 0 52859 9 0 0 25 0 1 0 520615804 116031488 18572 33554432000 4194304 4331988 140733525081632 18446744073709551615 4210400 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 28328 18572 175 34 0 26770 0
Current children cumulated CPU time (s) 4243.46
Current children cumulated vsize (KiB) 4777736

[startup+1122.3 s]
/proc/loadavg: 10.35 10.30 9.85 11/192 2145
/proc/meminfo: memFree=30195092/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1715168 CPUtime=1122.31 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 93016 0 0 0 112197 34 0 0 25 0 1 0 520615804 1756332032 38366 33554432000 4194304 4587354 140735913840976 18446744073709551615 4238595 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 428792 38366 337 96 0 425354 0
[pid=2079] ppid=2077 vsize=158524 CPUtime=1122.32 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 35372 0 0 0 112224 8 0 0 25 0 1 0 520615804 162328576 34831 33554432000 4194304 4785740 140734653060656 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 39631 34831 340 145 0 36676 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=557.69 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 55769 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=77684 CPUtime=1122.32 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 218241 0 0 0 112203 29 0 0 25 0 1 0 520615804 79548416 18615 33554432000 4194304 4352236 140735646844112 18446744073709551615 4329000 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 19421 18615 127 39 0 18501 0
[pid=2082] ppid=2077 vsize=120076 CPUtime=558.51 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 20125 0 0 0 55841 10 0 0 25 0 1 0 520615804 122957824 19817 33554432000 4194304 4331988 140733525081632 18446744073709551615 4237192 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 30019 19817 175 34 0 28461 0
Current children cumulated CPU time (s) 4483.15
Current children cumulated vsize (KiB) 2549168

[startup+1182.3 s]
/proc/loadavg: 10.40 10.32 9.89 11/192 2147
/proc/meminfo: memFree=30128964/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1703804 CPUtime=1182.33 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 97362 0 0 0 118195 38 0 0 25 0 1 0 520615804 1744695296 38366 33554432000 4194304 4587354 140735913840976 18446744073709551615 4238595 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 425951 38366 337 96 0 422513 0
[pid=2079] ppid=2077 vsize=160972 CPUtime=1182.32 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 35977 0 0 0 118224 8 0 0 25 0 1 0 520615804 164835328 35436 33554432000 4194304 4785740 140734653060656 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 40243 35436 340 145 0 37288 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=587.53 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 58753 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134530568 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=60788 CPUtime=1182.32 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 224449 0 0 0 118203 29 0 0 25 0 1 0 520615804 62246912 14391 33554432000 4194304 4352236 140735646844112 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 15197 14391 127 39 0 14277 0
[pid=2082] ppid=2077 vsize=120076 CPUtime=588.35 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 21209 0 0 0 58824 11 0 0 25 0 1 0 520615804 122957824 20901 33554432000 4194304 4331988 140733525081632 18446744073709551615 4226260 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 30019 20901 175 34 0 28461 0
Current children cumulated CPU time (s) 4722.85
Current children cumulated vsize (KiB) 2523356



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.28 10.30 9.89 11/192 2148
/proc/meminfo: memFree=30109852/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1703804 CPUtime=1201.72 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 98639 0 0 0 120134 38 0 0 25 0 1 0 520615804 1744695296 39614 33554432000 4194304 4587354 140735913840976 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 425951 39614 337 96 0 422513 0
[pid=2079] ppid=2077 vsize=161400 CPUtime=1201.73 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 36065 0 0 0 120165 8 0 0 25 0 1 0 520615804 165273600 35524 33554432000 4194304 4785740 140734653060656 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 40350 35524 340 145 0 37395 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=597.16 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 59716 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=63348 CPUtime=1201.72 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 225089 0 0 0 120143 29 0 0 25 0 1 0 520615804 64868352 15031 33554432000 4194304 4352236 140735646844112 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 15837 15031 127 39 0 14917 0
[pid=2082] ppid=2077 vsize=120076 CPUtime=598.01 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 21579 0 0 0 59790 11 0 0 25 0 1 0 520615804 122957824 21271 33554432000 4194304 4331988 140733525081632 18446744073709551615 4226474 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 30019 21271 175 34 0 28461 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 2526344

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 10.28 10.30 9.89 11/192 2148
/proc/meminfo: memFree=30109852/32951124 swapFree=67111344/67111528
[pid=2077] ppid=2075 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2077/stat : 2077 (ppfolio) S 2075 2077 379 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 520615804 18763776 389 33554432000 4194304 4287625 140737158705744 18446744073709551615 271550557711 0 0 4096 65536 4605776147723059199 0 0 17 1 0 0 0
/proc/2077/statm: 4581 389 341 23 0 91 0
[pid=2078] ppid=2077 vsize=1703804 CPUtime=1201.72 cores=1
/proc/2078/stat : 2078 (cryptominisat) R 2077 2077 379 0 -1 4202496 98639 0 0 0 120134 38 0 0 25 0 1 0 520615804 1744695296 39614 33554432000 4194304 4587354 140735913840976 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2078/statm: 425951 39614 337 96 0 422513 0
[pid=2079] ppid=2077 vsize=161400 CPUtime=1201.73 cores=5
/proc/2079/stat : 2079 (clasp) R 2077 2077 379 0 -1 4202496 36065 0 0 0 120165 8 0 0 25 0 1 0 520615804 165273600 35524 33554432000 4194304 4785740 140734653060656 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2079/statm: 40350 35524 340 145 0 37395 0
[pid=2080] ppid=2077 vsize=459392 CPUtime=597.16 cores=7
/proc/2080/stat : 2080 (TNM) R 2077 2077 379 0 -1 4202496 1837 0 0 0 59716 0 0 0 25 0 1 0 520615804 470417408 1734 33554432000 134512640 134534564 4293049808 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2080/statm: 114848 1734 95 6 0 113514 0
[pid=2081] ppid=2077 vsize=63348 CPUtime=1201.72 cores=3
/proc/2081/stat : 2081 (lingeling) R 2077 2077 379 0 -1 4202496 225089 0 0 0 120143 29 0 0 25 0 1 0 520615804 64868352 15031 33554432000 4194304 4352236 140735646844112 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2081/statm: 15837 15031 127 39 0 14917 0
[pid=2082] ppid=2077 vsize=120076 CPUtime=598.01 cores=7
/proc/2082/stat : 2082 (march_hi) R 2077 2077 379 0 -1 4202496 21579 0 0 0 59790 11 0 0 25 0 1 0 520615804 122957824 21271 33554432000 4194304 4331988 140733525081632 18446744073709551615 4226474 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2082/statm: 30019 21271 175 34 0 28461 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 2526344

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2077 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=5999
# CPU time returned by wait4() is 0.006998
# while last known CPU time is 4800.34
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.72
CPU time (s): 4800.34
CPU user time (s): 4799.48
CPU system time (s): 0.86
CPU usage (%): 399.457
Max. virtual memory (cumulated for all children) (KiB): 8485076

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.005999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 523
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 345
involuntary context switches= 6

runsolver used 1.81672 second user time and 4.74228 second system time

The end

Launcher Data 

Begin job on node133 at 2011-04-29 17:16:19
IDJOB=3262833
IDBENCH=83896
IDSOLVER=1612
FILE ID=node133/3262833-1304090179
RUNJOBID= node133-1304088977-1975
PBS_JOBID= 13170511
Free space on /tmp= 71884 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_27_50_3-dir.shuffled-as.sat03-169.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262833-1304090179/watcher-3262833-1304090179 -o /tmp/evaluation-result-3262833-1304090179/solver-3262833-1304090179 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3262833-1304090179.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b5a637600c242725f15a247a84bdea1b
RANDOM SEED=1130643244

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30806040 kB
Buffers:        746952 kB
Cached:         973712 kB
SwapCached:        124 kB
Active:         614740 kB
Inactive:      1171508 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30806040 kB
SwapTotal:    67111528 kB
SwapFree:     67111344 kB
Dirty:           10900 kB
Writeback:           0 kB
AnonPages:       65904 kB
Mapped:          15780 kB
Slab:           294036 kB
PageTables:       5344 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   220664 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71876 MiB
End job on node133 at 2011-04-29 17:36:23