Trace number 3191133

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.35 1201.71

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v90-c8010-S2127424322-078.UNKNOWN.cnf
MD5SUMf8b6732f9f469525eb7751d9d1024a94
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables90
Number of clauses8010
Sum of the clauses size56070
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58010

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191133-1304060751/watcher-3191133-1304060751 -o /tmp/evaluation-result-3191133-1304060751/solver-3191133-1304060751 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191133-1304060751.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.89 10.09 9.67 6/182 3614
/proc/meminfo: memFree=18058320/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) R 3612 3614 2759 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0

[startup+0.021192 s]
/proc/loadavg: 9.89 10.09 9.67 6/182 3614
/proc/meminfo: memFree=18058320/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) R 3612 3614 2759 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100178 s]
/proc/loadavg: 9.89 10.09 9.67 6/182 3614
/proc/meminfo: memFree=18058320/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300141 s]
/proc/loadavg: 9.89 10.09 9.67 6/182 3614
/proc/meminfo: memFree=18058320/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 521 0 0 0 0 0 0 0 24 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700068 s]
/proc/loadavg: 9.89 10.09 9.67 6/182 3614
/proc/meminfo: memFree=18058320/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 521 0 0 0 0 0 0 0 21 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50092 s]
/proc/loadavg: 9.89 10.09 9.67 11/188 3620
/proc/meminfo: memFree=18046152/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=27452 CPUtime=1.49 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 3292 0 0 0 149 0 0 0 25 0 1 0 517675556 28110848 1244 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 6863 1244 330 96 0 3425 0
[pid=3616] ppid=3614 vsize=15292 CPUtime=1.49 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 1268 0 0 0 149 0 0 0 25 0 1 0 517675556 15659008 1160 33554432000 4194304 4785740 140733991351376 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 3823 1160 340 145 0 868 0
[pid=3617] ppid=3614 vsize=452788 CPUtime=0.72 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 514 0 0 0 72 0 0 0 25 0 1 0 517675556 463654912 411 33554432000 134512640 134534564 4287902496 18446744073709551615 134524577 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 113197 411 91 6 0 111863 0
[pid=3618] ppid=3614 vsize=7956 CPUtime=1.49 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 1468 0 0 0 149 0 0 0 25 0 1 0 517675556 8146944 1183 33554432000 4194304 4352236 140734851198032 18446744073709551615 4278954 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 1989 1183 127 39 0 1069 0
[pid=3619] ppid=3614 vsize=8528 CPUtime=0.76 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 1989 0 0 0 76 0 0 0 25 0 1 0 517675556 8732672 600 33554432000 4194304 4331988 140736794030128 18446744073709551615 4299294 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 2132 600 174 34 0 574 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 530340

[startup+3.10063 s]
/proc/loadavg: 9.89 10.09 9.67 11/188 3620
/proc/meminfo: memFree=18032884/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=1911868 CPUtime=3.08 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 5986 0 0 0 308 0 0 0 25 0 1 0 517675556 1957752832 3396 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238435 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 477967 3396 336 96 0 474529 0
[pid=3616] ppid=3614 vsize=16164 CPUtime=3.09 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 1477 0 0 0 309 0 0 0 25 0 1 0 517675556 16551936 1369 33554432000 4194304 4785740 140733991351376 18446744073709551615 4549776 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 4041 1369 340 145 0 1086 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=1.52 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 152 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=7852 CPUtime=3.09 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 1662 0 0 0 309 0 0 0 25 0 1 0 517675556 8040448 1157 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328035 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 1963 1157 127 39 0 1043 0
[pid=3619] ppid=3614 vsize=8728 CPUtime=1.55 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 1999 0 0 0 155 0 0 0 25 0 1 0 517675556 8937472 610 33554432000 4194304 4331988 140736794030128 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 2182 610 174 34 0 624 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 2419700

[startup+6.30104 s]
/proc/loadavg: 9.98 10.11 9.68 11/188 3620
/proc/meminfo: memFree=18029884/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=1912508 CPUtime=6.29 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 7924 0 0 0 628 1 0 0 25 0 1 0 517675556 1958408192 3503 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238406 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 478127 3503 336 96 0 474689 0
[pid=3616] ppid=3614 vsize=17480 CPUtime=6.29 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 1783 0 0 0 629 0 0 0 25 0 1 0 517675556 17899520 1675 33554432000 4194304 4785740 140733991351376 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 4370 1675 340 145 0 1415 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=3.12 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 312 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134528918 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=7948 CPUtime=6.29 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 2048 0 0 0 629 0 0 0 25 0 1 0 517675556 8138752 1181 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 1987 1181 127 39 0 1067 0
[pid=3619] ppid=3614 vsize=9184 CPUtime=3.13 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 2098 0 0 0 313 0 0 0 25 0 1 0 517675556 9404416 709 33554432000 4194304 4331988 140736794030128 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 2296 709 175 34 0 738 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 2422208

[startup+12.7009 s]
/proc/loadavg: 9.98 10.11 9.68 11/188 3620
/proc/meminfo: memFree=18023332/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=44332 CPUtime=12.69 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 12807 0 0 0 1267 2 0 0 25 0 1 0 517675556 45395968 5267 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238618 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 11083 5267 336 96 0 7645 0
[pid=3616] ppid=3614 vsize=18896 CPUtime=12.69 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 2100 0 0 0 1269 0 0 0 25 0 1 0 517675556 19349504 1992 33554432000 4194304 4785740 140733991351376 18446744073709551615 4553366 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 4724 1992 340 145 0 1769 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=6.32 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 632 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134529632 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=10124 CPUtime=12.69 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 3168 0 0 0 1269 0 0 0 25 0 1 0 517675556 10366976 1725 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328162 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 2531 1725 127 39 0 1611 0
[pid=3619] ppid=3614 vsize=9752 CPUtime=6.3 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 2194 0 0 0 630 0 0 0 25 0 1 0 517675556 9986048 805 33554432000 4194304 4331988 140736794030128 18446744073709551615 4299299 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 2438 805 175 34 0 880 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 558192

[startup+25.5005 s]
/proc/loadavg: 9.99 10.10 9.68 11/188 3621
/proc/meminfo: memFree=18017268/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=44700 CPUtime=25.49 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 18835 0 0 0 2546 3 0 0 25 0 1 0 517675556 45772800 5369 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 11175 5369 336 96 0 7737 0
[pid=3616] ppid=3614 vsize=21368 CPUtime=25.48 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 2673 0 0 0 2548 0 0 0 25 0 1 0 517675556 21880832 2565 33554432000 4194304 4785740 140733991351376 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 5342 2565 341 145 0 2387 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=12.65 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 1265 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134528464 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=10604 CPUtime=25.49 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 4056 0 0 0 2549 0 0 0 25 0 1 0 517675556 10858496 1845 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328336 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 2651 1845 127 39 0 1731 0
[pid=3619] ppid=3614 vsize=10264 CPUtime=12.7 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 2391 0 0 0 1270 0 0 0 25 0 1 0 517675556 10510336 1002 33554432000 4194304 4331988 140736794030128 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 2566 1002 175 34 0 1008 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 562024

[startup+51.1008 s]
/proc/loadavg: 9.62 10.01 9.66 11/188 3718
/proc/meminfo: memFree=18222420/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=1921608 CPUtime=51.09 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 28867 0 0 0 5104 5 0 0 25 0 1 0 517675556 1967726592 6391 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238552 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 480402 6391 336 96 0 476964 0
[pid=3616] ppid=3614 vsize=24424 CPUtime=51.08 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 3347 0 0 0 5108 0 0 0 25 0 1 0 517675556 25010176 3239 33554432000 4194304 4785740 140733991351376 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 6106 3239 341 145 0 3151 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=25.42 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 2542 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134530186 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=12784 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/3619/statm: 17199 12929 175 34 0 15641 0
Current children cumulated CPU time (s) 3524.43
Current children cumulated vsize (KiB) 720544

[startup+942.307 s]
/proc/loadavg: 10.18 10.15 9.94 11/188 3774
/proc/meminfo: memFree=17884040/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=100368 CPUtime=942.32 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 134917 0 0 0 94187 45 0 0 25 0 1 0 517675556 102776832 20934 33554432000 4194304 4587354 140734539040416 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 25092 20934 336 96 0 21654 0
[pid=3616] ppid=3614 vsize=46012 CPUtime=942.32 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 8244 0 0 0 94230 2 0 0 25 0 1 0 517675556 47116288 8052 33554432000 4194304 4785740 140733991351376 18446744073709551615 4553440 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 11503 8052 341 145 0 8548 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=468.55 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 46855 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134528918 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=31096 CPUtime=942.32 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 41371 0 0 0 94227 5 0 0 25 0 1 0 517675556 31842304 6968 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 7774 6968 127 39 0 6854 0
[pid=3619] ppid=3614 vsize=68796 CPUtime=468.62 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 15030 0 0 0 46853 9 0 0 25 0 1 0 517675556 70447104 13641 33554432000 4194304 4331988 140736794030128 18446744073709551615 4287396 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 17199 13641 175 34 0 15641 0
Current children cumulated CPU time (s) 3764.13
Current children cumulated vsize (KiB) 721360

[startup+1002.3 s]
/proc/loadavg: 10.18 10.15 9.95 11/188 3776
/proc/meminfo: memFree=17874100/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=100496 CPUtime=1002.32 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 138681 0 0 0 100186 46 0 0 25 0 1 0 517675556 102907904 20846 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 25124 20846 336 96 0 21686 0
[pid=3616] ppid=3614 vsize=46388 CPUtime=1002.32 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 8359 0 0 0 100230 2 0 0 25 0 1 0 517675556 47501312 8167 33554432000 4194304 4785740 140733991351376 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 11597 8167 341 145 0 8642 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=498.43 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 49843 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=31864 CPUtime=1002.31 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 42843 0 0 0 100226 5 0 0 25 0 1 0 517675556 32628736 7160 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328380 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 7966 7160 127 39 0 7046 0
[pid=3619] ppid=3614 vsize=68796 CPUtime=498.42 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 15899 0 0 0 49832 10 0 0 25 0 1 0 517675556 70447104 14510 33554432000 4194304 4331988 140736794030128 18446744073709551615 4299185 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 17199 14510 175 34 0 15641 0
Current children cumulated CPU time (s) 4003.8
Current children cumulated vsize (KiB) 722632

[startup+1062.3 s]
/proc/loadavg: 10.18 10.15 9.96 11/188 3777
/proc/meminfo: memFree=17872340/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=100624 CPUtime=1062.32 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 142556 0 0 0 106184 48 0 0 25 0 1 0 517675556 103038976 20729 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 25156 20729 336 96 0 21718 0
[pid=3616] ppid=3614 vsize=47716 CPUtime=1062.32 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 8654 0 0 0 106230 2 0 0 25 0 1 0 517675556 48861184 8462 33554432000 4194304 4785740 140733991351376 18446744073709551615 4287011 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 11929 8462 341 145 0 8974 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=528.24 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 52824 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134530329 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=33400 CPUtime=1062.31 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 44507 0 0 0 106226 5 0 0 25 0 1 0 517675556 34201600 7544 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 8350 7544 127 39 0 7430 0
[pid=3619] ppid=3614 vsize=68796 CPUtime=528.27 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 16714 0 0 0 52817 10 0 0 25 0 1 0 517675556 70447104 15325 33554432000 4194304 4331988 140736794030128 18446744073709551615 4298550 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 17199 15325 175 34 0 15641 0
Current children cumulated CPU time (s) 4243.46
Current children cumulated vsize (KiB) 725624

[startup+1122.3 s]
/proc/loadavg: 10.16 10.15 9.97 11/188 3779
/proc/meminfo: memFree=17857804/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=2121708 CPUtime=1122.32 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 146203 0 0 0 112182 50 0 0 25 0 1 0 517675556 2172628992 20239 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238778 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 530427 20239 336 96 0 526989 0
[pid=3616] ppid=3614 vsize=48576 CPUtime=1122.32 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 8946 0 0 0 112230 2 0 0 25 0 1 0 517675556 49741824 8658 33554432000 4194304 4785740 140733991351376 18446744073709551615 4553437 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 12144 8658 341 145 0 9189 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=558.08 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 55808 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=31868 CPUtime=1122.32 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 46748 0 0 0 112226 6 0 0 25 0 1 0 517675556 32632832 7161 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 7967 7161 127 39 0 7047 0
[pid=3619] ppid=3614 vsize=98264 CPUtime=558.11 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 17566 0 0 0 55800 11 0 0 25 0 1 0 517675556 100622336 16177 33554432000 4194304 4331988 140736794030128 18446744073709551615 4210485 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 24566 16177 175 34 0 23008 0
Current children cumulated CPU time (s) 4483.15
Current children cumulated vsize (KiB) 2775504

[startup+1182.3 s]
/proc/loadavg: 10.15 10.15 9.98 11/188 3781
/proc/meminfo: memFree=17853692/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=12501616 CPUtime=1182.33 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 148250 0 0 0 118181 52 0 0 25 0 1 0 517675556 12801654784 18190 33554432000 4194304 4587354 140734539040416 18446744073709551615 4232088 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 3125404 18190 336 96 0 3121966 0
[pid=3616] ppid=3614 vsize=48672 CPUtime=1182.32 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 9025 0 0 0 118230 2 0 0 25 0 1 0 517675556 49840128 8689 33554432000 4194304 4785740 140733991351376 18446744073709551615 4278126 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 12168 8689 341 145 0 9213 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=587.93 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 58793 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=31868 CPUtime=1182.32 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 48028 0 0 0 118226 6 0 0 25 0 1 0 517675556 32632832 7161 33554432000 4194304 4352236 140734851198032 18446744073709551615 4328345 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 7967 7161 127 39 0 7047 0
[pid=3619] ppid=3614 vsize=98264 CPUtime=587.93 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 18390 0 0 0 58782 11 0 0 25 0 1 0 517675556 100622336 17001 33554432000 4194304 4331988 140736794030128 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 24566 17001 175 34 0 23008 0
Current children cumulated CPU time (s) 4722.83
Current children cumulated vsize (KiB) 13155508



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.19 10.16 9.99 11/188 3781
/proc/meminfo: memFree=17840276/32951124 swapFree=67111528/67111528
[pid=3614] ppid=3612 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/3614/stat : 3614 (ppfolio) S 3612 3614 2759 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 517675556 18763776 389 33554432000 4194304 4287625 140735593021680 18446744073709551615 230809185807 0 0 4096 65536 6605022538554671103 0 0 17 5 0 0 0
/proc/3614/statm: 4581 389 341 23 0 91 0
[pid=3615] ppid=3614 vsize=100880 CPUtime=1201.73 cores=1
/proc/3615/stat : 3615 (cryptominisat) R 3614 3614 2759 0 -1 4202496 151371 0 0 0 120120 53 0 0 25 0 1 0 517675556 103301120 21076 33554432000 4194304 4587354 140734539040416 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/3615/statm: 25220 21076 336 96 0 21782 0
[pid=3616] ppid=3614 vsize=48960 CPUtime=1201.73 cores=5
/proc/3616/stat : 3616 (clasp) R 3614 3614 2759 0 -1 4202496 9097 0 0 0 120171 2 0 0 25 0 1 0 517675556 50135040 8761 33554432000 4194304 4785740 140733991351376 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/3616/statm: 12240 8761 341 145 0 9285 0
[pid=3617] ppid=3614 vsize=456764 CPUtime=597.56 cores=7
/proc/3617/stat : 3617 (TNM) R 3614 3614 2759 0 -1 4202496 594 0 0 0 59756 0 0 0 25 0 1 0 517675556 467726336 491 33554432000 134512640 134534564 4287902496 18446744073709551615 134530664 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3617/statm: 114191 491 95 6 0 112857 0
[pid=3618] ppid=3614 vsize=33660 CPUtime=1201.73 cores=3
/proc/3618/stat : 3618 (lingeling) R 3614 3614 2759 0 -1 4202496 48476 0 0 0 120167 6 0 0 25 0 1 0 517675556 34467840 7609 33554432000 4194304 4352236 140734851198032 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/3618/statm: 8415 7609 127 39 0 7495 0
[pid=3619] ppid=3614 vsize=98264 CPUtime=597.6 cores=7
/proc/3619/stat : 3619 (march_hi) R 3614 3614 2759 0 -1 4202496 18661 0 0 0 59749 11 0 0 25 0 1 0 517675556 100622336 17272 33554432000 4194304 4331988 140736794030128 18446744073709551615 4226260 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/3619/statm: 24566 17272 175 34 0 23008 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 756852

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3614 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.005998
# while last known CPU time is 4800.35
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.35
CPU user time (s): 4799.63
CPU system time (s): 0.72
CPU usage (%): 399.459
Max. virtual memory (cumulated for all children) (KiB): 13160628

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 522
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 520
involuntary context switches= 6

runsolver used 1.85872 second user time and 4.70528 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-29 09:05:51
IDJOB=3191133
IDBENCH=82864
IDSOLVER=1612
FILE ID=node104/3191133-1304060751
RUNJOBID= node104-1304057377-2782
PBS_JOBID= 13170438
Free space on /tmp= 71540 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k7-r89-v90-c8010-S2127424322-078.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191133-1304060751/watcher-3191133-1304060751 -o /tmp/evaluation-result-3191133-1304060751/solver-3191133-1304060751 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191133-1304060751.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f8b6732f9f469525eb7751d9d1024a94
RANDOM SEED=338280764

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18058600 kB
Buffers:       2197040 kB
Cached:       11817880 kB
SwapCached:          0 kB
Active:        2594356 kB
Inactive:     11710232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18058600 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10476 kB
Writeback:           0 kB
AnonPages:      289000 kB
Mapped:          16940 kB
Slab:           523552 kB
PageTables:       5344 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1224240 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71528 MiB
End job on node104 at 2011-04-29 09:25:55