Trace number 3190922

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.17 1201.71

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v35000-c147000-S1268831169-016-UNKNOWN.cnf
MD5SUMcd155ee9ac243c838c94577589f0455b
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark221.016
Satisfiable
(Un)Satisfiability was proved
Number of variables35000
Number of clauses147000
Sum of the clauses size441000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3147000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3190922-1304045152/watcher-3190922-1304045152 -o /tmp/evaluation-result-3190922-1304045152/solver-3190922-1304045152 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3190922-1304045152.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.88 9.10 8.94 7/182 30452
/proc/meminfo: memFree=21352160/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 23 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0

[startup+0.467234 s]
/proc/loadavg: 8.88 9.10 8.94 7/182 30452
/proc/meminfo: memFree=21352160/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.500229 s]
/proc/loadavg: 8.88 9.10 8.94 7/182 30452
/proc/meminfo: memFree=21352160/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.600212 s]
/proc/loadavg: 8.88 9.10 8.94 7/182 30452
/proc/meminfo: memFree=21352160/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700194 s]
/proc/loadavg: 8.88 9.10 8.94 7/182 30452
/proc/meminfo: memFree=21352160/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 19 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50705 s]
/proc/loadavg: 8.88 9.10 8.94 11/188 30458
/proc/meminfo: memFree=21221912/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 19 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=57232 CPUtime=1.49 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 12871 0 0 0 148 1 0 0 25 0 1 0 248706521 58605568 9484 33554432000 4194304 4587354 140733727712496 18446744073709551615 268660358923 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 14308 9484 326 96 0 10870 0
[pid=30454] ppid=30452 vsize=31248 CPUtime=1.5 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 6926 0 0 0 149 1 0 0 25 0 1 0 248706521 31997952 5014 33554432000 4194304 4785740 140737127048832 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 7812 5014 340 145 0 4857 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=0.74 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 73 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=19360 CPUtime=1.5 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 6379 0 0 0 149 1 0 0 25 0 1 0 248706521 19824640 3496 33554432000 4194304 4352236 140736622158000 18446744073709551615 4280960 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 4840 3496 127 39 0 3920 0
[pid=30457] ppid=30452 vsize=27232 CPUtime=0.74 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 16299 0 0 0 72 2 0 0 25 0 1 0 248706521 27885568 3945 33554432000 4194304 4331988 140733396234464 18446744073709551615 4219860 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 6808 3945 141 34 0 5250 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 619384

[startup+3.10077 s]
/proc/loadavg: 9.05 9.13 8.95 11/188 30458
/proc/meminfo: memFree=21223152/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 18 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=94736 CPUtime=3.09 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 13780 0 0 0 307 2 0 0 25 0 1 0 248706521 97009664 10389 33554432000 4194304 4587354 140733727712496 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 23684 10389 326 96 0 20246 0
[pid=30454] ppid=30452 vsize=34692 CPUtime=3.09 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 7851 0 0 0 308 1 0 0 25 0 1 0 248706521 35524608 5939 33554432000 4194304 4785740 140737127048832 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 8673 5939 340 145 0 5718 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=1.54 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 153 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=19360 CPUtime=3.09 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 6379 0 0 0 308 1 0 0 25 0 1 0 248706521 19824640 3496 33554432000 4194304 4352236 140736622158000 18446744073709551615 4207874 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 4840 3496 127 39 0 3920 0
[pid=30457] ppid=30452 vsize=29780 CPUtime=1.53 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 30778 0 0 0 149 4 0 0 25 0 1 0 248706521 30494720 4583 33554432000 4194304 4331988 140733396234464 18446744073709551615 268660057842 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 7445 4583 144 34 0 5887 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 662880

[startup+6.30121 s]
/proc/loadavg: 9.05 9.13 8.95 11/188 30458
/proc/meminfo: memFree=21148384/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=94736 CPUtime=6.28 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 15458 0 0 0 626 2 0 0 25 0 1 0 248706521 97009664 12057 33554432000 4194304 4587354 140733727712496 18446744073709551615 268660358923 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 23684 12057 326 96 0 20246 0
[pid=30454] ppid=30452 vsize=47868 CPUtime=6.29 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 11151 0 0 0 627 2 0 0 25 0 1 0 248706521 49016832 9239 33554432000 4194304 4785740 140737127048832 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 11967 9239 340 145 0 9012 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=3.14 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 313 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134530484 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=19360 CPUtime=6.29 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 6379 0 0 0 628 1 0 0 25 0 1 0 248706521 19824640 3496 33554432000 4194304 4352236 140736622158000 18446744073709551615 4231337 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 4840 3496 127 39 0 3920 0
[pid=30457] ppid=30452 vsize=76848 CPUtime=3.1 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 48580 0 0 0 304 6 0 0 25 0 1 0 248706521 78692352 15976 33554432000 4194304 4331988 140733396234464 18446744073709551615 4228970 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 19212 15976 173 34 0 17654 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 723124

[startup+12.7011 s]
/proc/loadavg: 9.28 9.18 8.96 11/188 30458
/proc/meminfo: memFree=21121984/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=64728 CPUtime=12.68 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 20440 0 0 0 1264 4 0 0 25 0 1 0 248706521 66281472 10706 33554432000 4194304 4587354 140733727712496 18446744073709551615 4238731 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 16182 10706 327 96 0 12744 0
[pid=30454] ppid=30452 vsize=69896 CPUtime=12.69 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 16632 0 0 0 1265 4 0 0 25 0 1 0 248706521 71573504 14720 33554432000 4194304 4785740 140737127048832 18446744073709551615 4553068 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 17474 14720 340 145 0 14519 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=6.31 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 630 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134526098 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=23076 CPUtime=12.69 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 7819 0 0 0 1268 1 0 0 25 0 1 0 248706521 23629824 4936 33554432000 4194304 4352236 140736622158000 18446744073709551615 4327867 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 5769 4936 127 39 0 4849 0
[pid=30457] ppid=30452 vsize=78292 CPUtime=6.3 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 48941 0 0 0 624 6 0 0 25 0 1 0 248706521 80171008 16337 33554432000 4194304 4331988 140733396234464 18446744073709551615 4228955 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 19573 16337 173 34 0 18015 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 720304

[startup+25.5008 s]
/proc/loadavg: 9.39 9.20 8.97 11/188 30459
/proc/meminfo: memFree=21043328/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=67688 CPUtime=25.49 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 49486 0 0 0 2539 10 0 0 25 0 1 0 248706521 69312512 10585 33554432000 4194304 4587354 140733727712496 18446744073709551615 4230209 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 16922 10585 337 96 0 13484 0
[pid=30454] ppid=30452 vsize=114512 CPUtime=25.49 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 27746 0 0 0 2542 7 0 0 25 0 1 0 248706521 117260288 25834 33554432000 4194304 4785740 140737127048832 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 28628 25834 340 145 0 25673 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=12.65 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 1264 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=24468 CPUtime=25.49 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 8167 0 0 0 2548 1 0 0 25 0 1 0 248706521 25055232 5284 33554432000 4194304 4352236 140736622158000 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 6117 5284 127 39 0 5197 0
[pid=30457] ppid=30452 vsize=84996 CPUtime=12.7 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 50587 0 0 0 1263 7 0 0 25 0 1 0 248706521 87035904 17983 33554432000 4194304 4331988 140733396234464 18446744073709551615 4228968 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 21249 17983 173 34 0 19691 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 775976

[startup+51.1004 s]
/proc/loadavg: 9.60 9.27 9.00 11/188 30459
/proc/meminfo: memFree=20996260/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=1493200 CPUtime=51.08 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 86556 0 0 0 5091 17 0 0 25 0 1 0 248706521 1529036800 18048 33554432000 4194304 4587354 140733727712496 18446744073709551615 4236583 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 373300 18048 337 96 0 369862 0
[pid=30454] ppid=30452 vsize=136908 CPUtime=51.09 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 33206 0 0 0 5100 9 0 0 25 0 1 0 248706521 140193792 31294 33554432000 4194304 4785740 140737127048832 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 34227 31294 340 145 0 31272 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=25.41 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 2540 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134530538 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=28108 CPUtime=51.09 cores=2

################
# More data... #
################

/proc/30457/statm: 22965 19724 173 34 0 21407 0
Current children cumulated CPU time (s) 3763.97
Current children cumulated vsize (KiB) 2539420

[startup+1002.3 s]
/proc/loadavg: 10.10 10.14 9.75 11/188 30497
/proc/meminfo: memFree=20543816/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=1563600 CPUtime=1002.19 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 643555 0 0 0 100016 203 0 0 25 0 1 0 248706521 1601126400 38943 33554432000 4194304 4587354 140733727712496 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 390900 38943 337 96 0 387462 0
[pid=30454] ppid=30452 vsize=406272 CPUtime=1002.31 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 99617 0 0 0 100203 28 0 0 25 0 1 0 248706521 416022528 97705 33554432000 4194304 4785740 140737127048832 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 101568 97705 340 145 0 98613 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=498.41 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 49840 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=31220 CPUtime=1002.3 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 9855 0 0 0 100228 2 0 0 25 0 1 0 248706521 31969280 6972 33554432000 4194304 4352236 140736622158000 18446744073709551615 4328047 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 7805 6972 127 39 0 6885 0
[pid=30457] ppid=30452 vsize=91992 CPUtime=498.42 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 52358 0 0 0 49834 8 0 0 25 0 1 0 248706521 94199808 19754 33554432000 4194304 4331988 140733396234464 18446744073709551615 4228970 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 22998 19754 173 34 0 21440 0
Current children cumulated CPU time (s) 4003.63
Current children cumulated vsize (KiB) 2577396

[startup+1062.3 s]
/proc/loadavg: 10.12 10.14 9.77 11/188 30498
/proc/meminfo: memFree=20554204/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=1550600 CPUtime=1062.18 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 662564 0 0 0 106004 214 0 0 25 0 1 0 248706521 1587814400 33470 33554432000 4194304 4587354 140733727712496 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 387650 33470 337 96 0 384212 0
[pid=30454] ppid=30452 vsize=412408 CPUtime=1062.31 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 101080 0 0 0 106203 28 0 0 25 0 1 0 248706521 422305792 99168 33554432000 4194304 4785740 140737127048832 18446744073709551615 4286979 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 103102 99168 340 145 0 100147 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=528.26 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 52825 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=33268 CPUtime=1062.3 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 10367 0 0 0 106228 2 0 0 25 0 1 0 248706521 34066432 7484 33554432000 4194304 4352236 140736622158000 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 8317 7484 127 39 0 7397 0
[pid=30457] ppid=30452 vsize=92124 CPUtime=528.24 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 52384 0 0 0 52816 8 0 0 25 0 1 0 248706521 94334976 19780 33554432000 4194304 4331988 140733396234464 18446744073709551615 4228970 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 23031 19780 173 34 0 21473 0
Current children cumulated CPU time (s) 4243.29
Current children cumulated vsize (KiB) 2572712

[startup+1122.3 s]
/proc/loadavg: 10.19 10.16 9.80 11/188 30500
/proc/meminfo: memFree=20559764/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=1549812 CPUtime=1122.19 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 681874 0 0 0 111995 224 0 0 25 0 1 0 248706521 1587007488 27278 33554432000 4194304 4587354 140733727712496 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 387453 27278 337 96 0 384015 0
[pid=30454] ppid=30452 vsize=432088 CPUtime=1122.32 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 105965 0 0 0 112202 30 0 0 25 0 1 0 248706521 442458112 104053 33554432000 4194304 4785740 140737127048832 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 108022 104053 340 145 0 105067 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=558.07 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 55806 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=33268 CPUtime=1122.31 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 10367 0 0 0 112229 2 0 0 25 0 1 0 248706521 34066432 7484 33554432000 4194304 4352236 140736622158000 18446744073709551615 4329349 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 8317 7484 127 39 0 7397 0
[pid=30457] ppid=30452 vsize=92256 CPUtime=558.12 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 52409 0 0 0 55803 9 0 0 25 0 1 0 248706521 94470144 19805 33554432000 4194304 4331988 140733396234464 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 23064 19805 173 34 0 21506 0
Current children cumulated CPU time (s) 4483.01
Current children cumulated vsize (KiB) 2591736

[startup+1182.3 s]
/proc/loadavg: 10.18 10.16 9.82 11/188 30502
/proc/meminfo: memFree=20511376/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=1539484 CPUtime=1182.18 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 701995 0 0 0 117984 234 0 0 25 0 1 0 248706521 1576431616 34244 33554432000 4194304 4587354 140733727712496 18446744073709551615 4236606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 384871 34244 337 96 0 381433 0
[pid=30454] ppid=30452 vsize=434680 CPUtime=1182.31 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 106581 0 0 0 118201 30 0 0 25 0 1 0 248706521 445112320 104669 33554432000 4194304 4785740 140737127048832 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 108670 104669 340 145 0 105715 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=587.94 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 58793 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=33268 CPUtime=1182.31 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 10367 0 0 0 118229 2 0 0 25 0 1 0 248706521 34066432 7484 33554432000 4194304 4352236 140736622158000 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 8317 7484 127 39 0 7397 0
[pid=30457] ppid=30452 vsize=92256 CPUtime=587.92 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 52428 0 0 0 58783 9 0 0 25 0 1 0 248706521 94470144 19824 33554432000 4194304 4331988 140733396234464 18446744073709551615 4228871 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 23064 19824 173 34 0 21506 0
Current children cumulated CPU time (s) 4722.66
Current children cumulated vsize (KiB) 2584000



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.21 10.16 9.83 11/188 30567
/proc/meminfo: memFree=20672152/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=1541312 CPUtime=1201.58 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 708445 0 0 0 119920 238 0 0 25 0 1 0 248706521 1578303488 27375 33554432000 4194304 4587354 140733727712496 18446744073709551615 4238712 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 385328 27375 337 96 0 381890 0
[pid=30454] ppid=30452 vsize=434680 CPUtime=1201.73 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 106581 0 0 0 120142 31 0 0 25 0 1 0 248706521 445112320 104669 33554432000 4194304 4785740 140737127048832 18446744073709551615 4287237 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 108670 104669 340 145 0 105715 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=597.55 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 59754 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134525956 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=33268 CPUtime=1201.71 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 10367 0 0 0 120169 2 0 0 25 0 1 0 248706521 34066432 7484 33554432000 4194304 4352236 140736622158000 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 8317 7484 127 39 0 7397 0
[pid=30457] ppid=30452 vsize=92388 CPUtime=597.6 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 52434 0 0 0 59751 9 0 0 25 0 1 0 248706521 94605312 19830 33554432000 4194304 4331988 140733396234464 18446744073709551615 4263253 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 23097 19830 173 34 0 21539 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 2585960

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 10.21 10.16 9.83 11/188 30567
/proc/meminfo: memFree=20672152/32951124 swapFree=67111528/67111528
[pid=30452] ppid=30450 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30452/stat : 30452 (ppfolio) S 30450 30452 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248706521 18763776 390 33554432000 4194304 4287625 140737057608848 18446744073709551615 268660682255 0 0 4096 65536 4345112452225040383 0 0 17 2 0 0 0
/proc/30452/statm: 4581 390 341 23 0 91 0
[pid=30453] ppid=30452 vsize=1541312 CPUtime=1201.58 cores=0
/proc/30453/stat : 30453 (cryptominisat) R 30452 30452 30178 0 -1 4202496 708445 0 0 0 119920 238 0 0 25 0 1 0 248706521 1578303488 27375 33554432000 4194304 4587354 140733727712496 18446744073709551615 4238712 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30453/statm: 385328 27375 337 96 0 381890 0
[pid=30454] ppid=30452 vsize=434680 CPUtime=1201.73 cores=4
/proc/30454/stat : 30454 (clasp) R 30452 30452 30178 0 -1 4202496 106581 0 0 0 120142 31 0 0 25 0 1 0 248706521 445112320 104669 33554432000 4194304 4785740 140737127048832 18446744073709551615 4287237 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30454/statm: 108670 104669 340 145 0 105715 0
[pid=30455] ppid=30452 vsize=465988 CPUtime=597.55 cores=6
/proc/30455/stat : 30455 (TNM) R 30452 30452 30178 0 -1 4202496 5914 0 0 0 59754 1 0 0 25 0 1 0 248706521 477171712 5810 33554432000 134512640 134534564 4294838128 18446744073709551615 134525956 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30455/statm: 116497 5810 95 6 0 115163 0
[pid=30456] ppid=30452 vsize=33268 CPUtime=1201.71 cores=2
/proc/30456/stat : 30456 (lingeling) R 30452 30452 30178 0 -1 4202496 10367 0 0 0 120169 2 0 0 25 0 1 0 248706521 34066432 7484 33554432000 4194304 4352236 140736622158000 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30456/statm: 8317 7484 127 39 0 7397 0
[pid=30457] ppid=30452 vsize=92388 CPUtime=597.6 cores=6
/proc/30457/stat : 30457 (march_hi) R 30452 30452 30178 0 -1 4202496 52434 0 0 0 59751 9 0 0 25 0 1 0 248706521 94605312 19830 33554432000 4194304 4331988 140733396234464 18446744073709551615 4263253 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30457/statm: 23097 19830 173 34 0 21539 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 2585960

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30452 and gives
#  childrusage.ru_utime.tv_sec=1799
#  childrusage.ru_utime.tv_usec=215477
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=131979
# CPU time returned by wait4() is 1799.35
# while last known CPU time is 4800.17
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.17
CPU user time (s): 4797.36
CPU system time (s): 2.81
CPU usage (%): 399.444
Max. virtual memory (cumulated for all children) (KiB): 4008012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.22
system time used= 0.131979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 63327
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 231
involuntary context switches= 14547

runsolver used 1.78673 second user time and 4.77927 second system time

The end

Launcher Data 

Begin job on node107 at 2011-04-29 04:45:53
IDJOB=3190922
IDBENCH=82653
IDSOLVER=1612
FILE ID=node107/3190922-1304045152
RUNJOBID= node107-1304042629-30196
PBS_JOBID= 13170385
Free space on /tmp= 71788 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v35000-c147000-S1268831169-016-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3190922-1304045152/watcher-3190922-1304045152 -o /tmp/evaluation-result-3190922-1304045152/solver-3190922-1304045152 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3190922-1304045152.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cd155ee9ac243c838c94577589f0455b
RANDOM SEED=656867550

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21352316 kB
Buffers:       2018732 kB
Cached:        8988760 kB
SwapCached:          0 kB
Active:        3065248 kB
Inactive:      8052744 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21352316 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           23468 kB
Writeback:           0 kB
AnonPages:      110060 kB
Mapped:          16712 kB
Slab:           416196 kB
PageTables:       5204 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   707916 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71776 MiB
End job on node107 at 2011-04-29 05:05:56