Trace number 3191014

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.27 1201.81

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S375894551-007.UNKNOWN.cnf
MD5SUMa88511669158afb29f3ddcebdff7b380
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191014-1304053121/watcher-3191014-1304053121 -o /tmp/evaluation-result-3191014-1304053121/solver-3191014-1304053121 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191014-1304053121.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.75 4.27 5.58 7/180 4114
/proc/meminfo: memFree=16788608/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) R 4112 4114 3050 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0

[startup+0.269245 s]
/proc/loadavg: 3.75 4.27 5.58 7/180 4114
/proc/meminfo: memFree=16788608/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.30024 s]
/proc/loadavg: 3.75 4.27 5.58 7/180 4114
/proc/meminfo: memFree=16788608/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 24 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.400223 s]
/proc/loadavg: 3.75 4.27 5.58 7/180 4114
/proc/meminfo: memFree=16788608/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 23 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700173 s]
/proc/loadavg: 3.75 4.27 5.58 7/180 4114
/proc/meminfo: memFree=16788608/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 20 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50104 s]
/proc/loadavg: 4.25 4.36 5.60 11/186 4120
/proc/meminfo: memFree=16766736/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=126476 CPUtime=1.49 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 4342 0 0 0 149 0 0 0 25 0 1 0 516911695 129511424 2868 33554432000 4194304 4587354 140736096040384 18446744073709551615 4364788 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 31619 2868 337 96 0 28181 0
[pid=4116] ppid=4114 vsize=14328 CPUtime=1.49 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 1033 0 0 0 149 0 0 0 25 0 1 0 516911695 14671872 924 33554432000 4194304 4785740 140736652303760 18446744073709551615 4278016 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 3582 924 340 145 0 627 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=0.74 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 74 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134530353 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=6272 CPUtime=1.49 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 1171 0 0 0 149 0 0 0 25 0 1 0 516911695 6422528 761 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328162 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 1568 761 127 39 0 648 0
[pid=4119] ppid=4114 vsize=7632 CPUtime=0.73 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 553 0 0 0 73 0 0 0 25 0 1 0 516911695 7815168 438 33554432000 4194304 4331988 140737102542096 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 1908 438 174 34 0 350 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 629120

[startup+3.10077 s]
/proc/loadavg: 4.25 4.36 5.60 12/186 4120
/proc/meminfo: memFree=16763900/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=130044 CPUtime=3.08 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 6422 0 0 0 308 0 0 0 25 0 1 0 516911695 133165056 3871 33554432000 4194304 4587354 140736096040384 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 32511 3871 337 96 0 29073 0
[pid=4116] ppid=4114 vsize=15012 CPUtime=3.09 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 1209 0 0 0 309 0 0 0 25 0 1 0 516911695 15372288 1100 33554432000 4194304 4785740 140736652303760 18446744073709551615 4553363 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 3753 1100 340 145 0 798 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=1.54 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 154 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134530268 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=6492 CPUtime=3.09 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 1364 0 0 0 309 0 0 0 25 0 1 0 516911695 6647808 816 33554432000 4194304 4352236 140736560042240 18446744073709551615 4329043 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 1623 816 127 39 0 703 0
[pid=4119] ppid=4114 vsize=7884 CPUtime=1.53 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 602 0 0 0 153 0 0 0 25 0 1 0 516911695 8073216 487 33554432000 4194304 4331988 140737102542096 18446744073709551615 4263331 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 1971 487 175 34 0 413 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 633844

[startup+6.30123 s]
/proc/loadavg: 4.95 4.50 5.64 11/186 4121
/proc/meminfo: memFree=16754900/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=130304 CPUtime=6.29 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 8613 0 0 0 628 1 0 0 25 0 1 0 516911695 133431296 4104 33554432000 4194304 4587354 140736096040384 18446744073709551615 4237695 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 32576 4104 337 96 0 29138 0
[pid=4116] ppid=4114 vsize=16008 CPUtime=6.29 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 1443 0 0 0 629 0 0 0 25 0 1 0 516911695 16392192 1334 33554432000 4194304 4785740 140736652303760 18446744073709551615 4287011 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 4002 1334 340 145 0 1047 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=3.14 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 314 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134530484 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=8288 CPUtime=6.29 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 2005 0 0 0 629 0 0 0 25 0 1 0 516911695 8486912 1265 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328022 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 2072 1265 127 39 0 1152 0
[pid=4119] ppid=4114 vsize=8452 CPUtime=3.11 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 696 0 0 0 311 0 0 0 25 0 1 0 516911695 8654848 581 33554432000 4194304 4331988 140737102542096 18446744073709551615 4299144 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 2113 581 175 34 0 555 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 637464

[startup+12.7012 s]
/proc/loadavg: 5.35 4.59 5.67 11/186 4121
/proc/meminfo: memFree=16743784/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=809240 CPUtime=12.68 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 13697 0 0 0 1266 2 0 0 25 0 1 0 516911695 828661760 4863 33554432000 4194304 4587354 140736096040384 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 202310 4863 337 96 0 198872 0
[pid=4116] ppid=4114 vsize=17428 CPUtime=12.69 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 1768 0 0 0 1269 0 0 0 25 0 1 0 516911695 17846272 1659 33554432000 4194304 4785740 140736652303760 18446744073709551615 4287030 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 4357 1659 340 145 0 1402 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=6.31 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 631 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=8164 CPUtime=12.69 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 2678 0 0 0 1269 0 0 0 25 0 1 0 516911695 8359936 1234 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328075 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 2041 1234 127 39 0 1121 0
[pid=4119] ppid=4114 vsize=8964 CPUtime=6.31 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 885 0 0 0 631 0 0 0 25 0 1 0 516911695 9179136 770 33554432000 4194304 4331988 140737102542096 18446744073709551615 4239578 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 2241 770 175 34 0 683 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 1318208

[startup+25.507 s]
/proc/loadavg: 6.07 4.77 5.71 11/186 4121
/proc/meminfo: memFree=16724228/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=813760 CPUtime=25.49 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 21280 0 0 0 2545 4 0 0 25 0 1 0 516911695 833290240 5764 33554432000 4194304 4587354 140736096040384 18446744073709551615 4238947 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 203440 5764 337 96 0 200002 0
[pid=4116] ppid=4114 vsize=19052 CPUtime=25.49 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 2175 0 0 0 2549 0 0 0 25 0 1 0 516911695 19509248 2066 33554432000 4194304 4785740 140736652303760 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 4763 2066 340 145 0 1808 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=12.64 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 1264 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134528888 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=11112 CPUtime=25.49 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 4855 0 0 0 2549 0 0 0 25 0 1 0 516911695 11378688 1971 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 2778 1971 127 39 0 1858 0
[pid=4119] ppid=4114 vsize=10880 CPUtime=12.7 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 1212 0 0 0 1270 0 0 0 25 0 1 0 516911695 11141120 1097 33554432000 4194304 4331988 140737102542096 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 2720 1097 175 34 0 1162 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 1329216

[startup+51.1007 s]
/proc/loadavg: 7.75 5.30 5.86 11/186 4122
/proc/meminfo: memFree=16681288/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=153200 CPUtime=51.07 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 32006 0 0 0 5102 5 0 0 25 0 1 0 516911695 156876800 9385 33554432000 4194304 4587354 140736096040384 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 38300 9386 337 96 0 34862 0
[pid=4116] ppid=4114 vsize=21780 CPUtime=51.07 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 2779 0 0 0 5107 0 0 0 25 0 1 0 516911695 22302720 2670 33554432000 4194304 4785740 140736652303760 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 5445 2670 340 145 0 2490 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=25.39 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 2539 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134530664 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=13164 CPUtime=51.08 cores=3

################
# More data... #
################

/proc/4119/statm: 24917 21494 175 34 0 23359 0
Current children cumulated CPU time (s) 3524.04
Current children cumulated vsize (KiB) 1483408

[startup+942.301 s]
/proc/loadavg: 10.14 9.93 8.51 12/186 4158
/proc/meminfo: memFree=16311044/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=887748 CPUtime=942.25 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 172881 0 0 0 94173 52 0 0 25 0 1 0 516911695 909053952 26785 33554432000 4194304 4587354 140736096040384 18446744073709551615 4238668 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 221937 26785 337 96 0 218499 0
[pid=4116] ppid=4114 vsize=37668 CPUtime=942.08 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 6428 0 0 0 94207 1 0 0 25 0 1 0 516911695 38572032 6319 33554432000 4194304 4785740 140736652303760 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 9417 6319 341 145 0 6462 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=468.57 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 46857 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134528944 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=29600 CPUtime=942.25 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 63913 0 0 0 94216 9 0 0 25 0 1 0 516911695 30310400 6578 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328095 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 7400 6578 127 39 0 6480 0
[pid=4119] ppid=4114 vsize=99668 CPUtime=468.54 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 22844 0 0 0 46843 11 0 0 25 0 1 0 516911695 102060032 22729 33554432000 4194304 4331988 140737102542096 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 24917 22729 175 34 0 23359 0
Current children cumulated CPU time (s) 3763.69
Current children cumulated vsize (KiB) 1529096

[startup+1002.31 s]
/proc/loadavg: 10.18 9.99 8.62 11/186 4159
/proc/meminfo: memFree=16344884/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=871704 CPUtime=1002.26 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 174264 0 0 0 100173 53 0 0 25 0 1 0 516911695 892624896 22433 33554432000 4194304 4587354 140736096040384 18446744073709551615 4245151 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 217926 22433 337 96 0 214488 0
[pid=4116] ppid=4114 vsize=37920 CPUtime=1002.09 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 6483 0 0 0 100208 1 0 0 25 0 1 0 516911695 38830080 6374 33554432000 4194304 4785740 140736652303760 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 9480 6374 341 145 0 6525 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=498.37 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 49837 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134530598 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=24608 CPUtime=1002.26 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 65833 0 0 0 100217 9 0 0 25 0 1 0 516911695 25198592 5330 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328032 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 6152 5330 127 39 0 5232 0
[pid=4119] ppid=4114 vsize=143868 CPUtime=498.42 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 24016 0 0 0 49830 12 0 0 25 0 1 0 516911695 147320832 23901 33554432000 4194304 4331988 140737102542096 18446744073709551615 4226457 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 35967 23901 175 34 0 34409 0
Current children cumulated CPU time (s) 4003.4
Current children cumulated vsize (KiB) 1552512

[startup+1062.3 s]
/proc/loadavg: 10.10 10.00 8.71 11/186 4161
/proc/meminfo: memFree=16331728/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=871704 CPUtime=1062.25 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 175339 0 0 0 106171 54 0 0 25 0 1 0 516911695 892624896 22947 33554432000 4194304 4587354 140736096040384 18446744073709551615 4232133 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 217926 22947 337 96 0 214488 0
[pid=4116] ppid=4114 vsize=38172 CPUtime=1062.08 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 6538 0 0 0 106207 1 0 0 25 0 1 0 516911695 39088128 6429 33554432000 4194304 4785740 140736652303760 18446744073709551615 4549842 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 9543 6429 341 145 0 6588 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=528.24 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 52824 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134530549 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=26144 CPUtime=1062.25 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 69641 0 0 0 106216 9 0 0 25 0 1 0 516911695 26771456 5714 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 6536 5714 127 39 0 5616 0
[pid=4119] ppid=4114 vsize=143868 CPUtime=528.22 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 25234 0 0 0 52809 13 0 0 25 0 1 0 516911695 147320832 25119 33554432000 4194304 4331988 140737102542096 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 35967 25119 175 34 0 34409 0
Current children cumulated CPU time (s) 4243.04
Current children cumulated vsize (KiB) 1554300

[startup+1122.3 s]
/proc/loadavg: 10.18 10.04 8.80 11/186 4162
/proc/meminfo: memFree=16309032/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=871704 CPUtime=1122.26 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 180390 0 0 0 112170 56 0 0 25 0 1 0 516911695 892624896 22725 33554432000 4194304 4587354 140736096040384 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 217926 22725 337 96 0 214488 0
[pid=4116] ppid=4114 vsize=38892 CPUtime=1122.07 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 6718 0 0 0 112206 1 0 0 25 0 1 0 516911695 39825408 6609 33554432000 4194304 4785740 140736652303760 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 9723 6609 341 145 0 6768 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=558.06 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 55806 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134530268 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=29856 CPUtime=1122.25 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 72809 0 0 0 112215 10 0 0 25 0 1 0 516911695 30572544 6642 33554432000 4194304 4352236 140736560042240 18446744073709551615 4295626 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 7464 6642 127 39 0 6544 0
[pid=4119] ppid=4114 vsize=147700 CPUtime=558.07 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 26701 0 0 0 55793 14 0 0 25 0 1 0 516911695 151244800 26586 33554432000 4194304 4331988 140737102542096 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 36925 26586 175 34 0 35367 0
Current children cumulated CPU time (s) 4482.71
Current children cumulated vsize (KiB) 1562564

[startup+1182.3 s]
/proc/loadavg: 10.14 10.05 8.88 11/186 4164
/proc/meminfo: memFree=16313240/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=871704 CPUtime=1182.25 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 181314 0 0 0 118169 56 0 0 25 0 1 0 516911695 892624896 22433 33554432000 4194304 4587354 140736096040384 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 217926 22433 337 96 0 214488 0
[pid=4116] ppid=4114 vsize=39144 CPUtime=1182.07 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 6742 0 0 0 118206 1 0 0 25 0 1 0 516911695 40083456 6633 33554432000 4194304 4785740 140736652303760 18446744073709551615 4308910 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 9786 6633 341 145 0 6831 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=587.89 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 58789 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134528988 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=22688 CPUtime=1182.24 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 74441 0 0 0 118214 10 0 0 25 0 1 0 516911695 23232512 4850 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 5672 4850 127 39 0 4752 0
[pid=4119] ppid=4114 vsize=147700 CPUtime=587.91 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 28124 0 0 0 58776 15 0 0 25 0 1 0 516911695 151244800 28009 33554432000 4194304 4331988 140737102542096 18446744073709551615 4226235 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 36925 28009 175 34 0 35367 0
Current children cumulated CPU time (s) 4722.36
Current children cumulated vsize (KiB) 1555648



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 10.17 10.06 8.91 6/179 4165
/proc/meminfo: memFree=16554220/32951132 swapFree=67111524/67111528
[pid=4114] ppid=4112 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/4114/stat : 4114 (ppfolio) S 4112 4114 3050 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 516911695 18763776 390 33554432000 4194304 4287625 140736784524192 18446744073709551615 210647166479 0 0 4096 65536 6724103221255602175 0 0 17 1 0 0 0
/proc/4114/statm: 4581 390 341 23 0 91 0
[pid=4115] ppid=4114 vsize=871704 CPUtime=1201.76 cores=1
/proc/4115/stat : 4115 (cryptominisat) R 4114 4114 3050 0 -1 4202496 181918 0 0 0 120119 57 0 0 25 0 1 0 516911695 892624896 22434 33554432000 4194304 4587354 140736096040384 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4115/statm: 217926 22434 337 96 0 214488 0
[pid=4116] ppid=4114 vsize=39144 CPUtime=1201.57 cores=5
/proc/4116/stat : 4116 (clasp) R 4114 4114 3050 0 -1 4202496 6748 0 0 0 120156 1 0 0 25 0 1 0 516911695 40083456 6639 33554432000 4194304 4785740 140736652303760 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/4116/statm: 9786 6639 341 145 0 6831 0
[pid=4117] ppid=4114 vsize=456088 CPUtime=597.58 cores=7
/proc/4117/stat : 4117 (TNM) R 4114 4114 3050 0 -1 4202496 388 0 0 0 59758 0 0 0 25 0 1 0 516911695 467034112 285 33554432000 134512640 134534564 4294308304 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4117/statm: 114022 285 95 6 0 112688 0
[pid=4118] ppid=4114 vsize=24608 CPUtime=1201.75 cores=3
/proc/4118/stat : 4118 (lingeling) R 4114 4114 3050 0 -1 4202496 74921 0 0 0 120165 10 0 0 25 0 1 0 516911695 25198592 5330 33554432000 4194304 4352236 140736560042240 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/4118/statm: 6152 5330 127 39 0 5232 0
[pid=4119] ppid=4114 vsize=147700 CPUtime=597.61 cores=7
/proc/4119/stat : 4119 (march_hi) R 4114 4114 3050 0 -1 4202496 28603 0 0 0 59746 15 0 0 25 0 1 0 516911695 151244800 28488 33554432000 4194304 4331988 140737102542096 18446744073709551615 4299040 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/4119/statm: 36925 28488 175 34 0 35367 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 1557568

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4114 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.005998
# while last known CPU time is 4800.27
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.81
CPU time (s): 4800.27
CPU user time (s): 4799.44
CPU system time (s): 0.83
CPU usage (%): 399.419
Max. virtual memory (cumulated for all children) (KiB): 2318508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 524
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 432
involuntary context switches= 6

runsolver used 1.9837 second user time and 4.5823 second system time

The end

Launcher Data 

Begin job on node129 at 2011-04-29 06:58:41
IDJOB=3191014
IDBENCH=82745
IDSOLVER=1612
FILE ID=node129/3191014-1304053121
RUNJOBID= node129-1304053118-3994
PBS_JOBID= 13170395
Free space on /tmp= 66360 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S375894551-007.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191014-1304053121/watcher-3191014-1304053121 -o /tmp/evaluation-result-3191014-1304053121/solver-3191014-1304053121 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191014-1304053121.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a88511669158afb29f3ddcebdff7b380
RANDOM SEED=1982291040

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      16788888 kB
Buffers:       1278612 kB
Cached:       14135212 kB
SwapCached:          4 kB
Active:        3781760 kB
Inactive:     11715088 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      16788888 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           20232 kB
Writeback:           0 kB
AnonPages:       82556 kB
Mapped:          17548 kB
Slab:           603812 kB
PageTables:       4948 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:  1456928 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66360 MiB
End job on node129 at 2011-04-29 07:18:45