Trace number 3266441

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.33 1201.62

General information on the benchmark

NameSAT02/handmade/simon/
satex-challenges/c6288.shuffled.cnf
MD5SUM75bd8319132b47c2d2e6f0889735a248
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.865867
Satisfiable
(Un)Satisfiability was proved
Number of variables5008
Number of clauses14813
Sum of the clauses size34485
Maximum clause length33
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 29982
Number of clauses of size 34829
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3266441-1304097065/watcher-3266441-1304097065 -o /tmp/evaluation-result-3266441-1304097065/solver-3266441-1304097065 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3266441-1304097065.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.81 5.02 5.85 1/171 15597
/proc/meminfo: memFree=23087352/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) R 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0

[startup+0.436067 s]
/proc/loadavg: 4.81 5.02 5.85 1/171 15597
/proc/meminfo: memFree=23087352/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 21 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.536045 s]
/proc/loadavg: 4.81 5.02 5.85 1/171 15597
/proc/meminfo: memFree=23087352/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 21 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.601036 s]
/proc/loadavg: 4.81 5.02 5.85 1/171 15597
/proc/meminfo: memFree=23087352/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 21 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701036 s]
/proc/loadavg: 4.81 5.02 5.85 1/171 15597
/proc/meminfo: memFree=23087352/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 18 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50687 s]
/proc/loadavg: 4.98 5.05 5.86 6/177 15603
/proc/meminfo: memFree=23064736/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1666040 CPUtime=1.49 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 2746 0 0 0 149 0 0 0 23 0 1 0 521306899 1706024960 1695 33554432000 4194304 4587354 140734126595104 18446744073709551615 4238273 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 416510 1695 327 96 0 413072 0
[pid=15599] ppid=15597 vsize=16416 CPUtime=1.5 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 1667 0 0 0 150 0 0 0 25 0 1 0 521306899 16809984 1432 33554432000 4194304 4785740 140734419629392 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 4104 1432 340 145 0 1149 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=0.78 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 78 0 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134528250 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=6840 CPUtime=1.49 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 1319 0 0 0 149 0 0 0 25 0 1 0 521306899 7004160 878 33554432000 4194304 4352236 140736858197104 18446744073709551615 4207627 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 1710 878 127 39 0 790 0
[pid=15602] ppid=15597 vsize=17620 CPUtime=0.69 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 4527 0 0 0 69 0 0 0 25 0 1 0 521306899 18042880 1747 33554432000 4194304 4331988 140735178023808 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 4405 1747 175 34 0 2847 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 2181992

[startup+3.10059 s]
/proc/loadavg: 4.98 5.05 5.86 6/177 15603
/proc/meminfo: memFree=23062128/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=29724 CPUtime=3.08 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 3681 0 0 0 308 0 0 0 25 0 1 0 521306899 30437376 1849 33554432000 4194304 4587354 140734126595104 18446744073709551615 4243616 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 7431 1849 331 96 0 3993 0
[pid=15599] ppid=15597 vsize=17344 CPUtime=3.09 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 1903 0 0 0 309 0 0 0 25 0 1 0 521306899 17760256 1668 33554432000 4194304 4785740 140734419629392 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 4336 1668 340 145 0 1381 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=1.57 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 157 0 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=7872 CPUtime=3.09 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 1609 0 0 0 309 0 0 0 25 0 1 0 521306899 8060928 1168 33554432000 4194304 4352236 140736858197104 18446744073709551615 4276662 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 1968 1168 127 39 0 1048 0
[pid=15602] ppid=15597 vsize=18096 CPUtime=1.49 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 4641 0 0 0 149 0 0 0 25 0 1 0 521306899 18530304 1859 33554432000 4194304 4331988 140735178023808 18446744073709551615 4298842 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 4524 1859 175 34 0 2966 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 548112

[startup+6.301 s]
/proc/loadavg: 4.99 5.05 5.85 6/177 15603
/proc/meminfo: memFree=23057044/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1676416 CPUtime=6.29 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 5106 0 0 0 628 1 0 0 25 0 1 0 521306899 1716649984 2650 33554432000 4194304 4587354 140734126595104 18446744073709551615 4236552 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 419104 2650 339 96 0 415666 0
[pid=15599] ppid=15597 vsize=18168 CPUtime=6.29 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 2100 0 0 0 629 0 0 0 25 0 1 0 521306899 18604032 1865 33554432000 4194304 4785740 140734419629392 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 4542 1865 340 145 0 1587 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=3.16 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 316 0 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134528926 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=7236 CPUtime=6.29 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 1801 0 0 0 629 0 0 0 25 0 1 0 521306899 7409664 1009 33554432000 4194304 4352236 140736858197104 18446744073709551615 4207874 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 1809 1009 127 39 0 889 0
[pid=15602] ppid=15597 vsize=18720 CPUtime=3.09 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 4781 0 0 0 309 0 0 0 25 0 1 0 521306899 19169280 1999 33554432000 4194304 4331988 140735178023808 18446744073709551615 4237382 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 4680 1999 175 34 0 3122 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 2195616

[startup+12.7008 s]
/proc/loadavg: 4.99 5.05 5.85 6/177 15603
/proc/meminfo: memFree=23043176/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1677828 CPUtime=12.69 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 9116 0 0 0 1268 1 0 0 25 0 1 0 521306899 1718095872 5205 33554432000 4194304 4587354 140734126595104 18446744073709551615 4241151 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 419457 5205 339 96 0 416019 0
[pid=15599] ppid=15597 vsize=19896 CPUtime=12.69 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 2538 0 0 0 1269 0 0 0 25 0 1 0 521306899 20373504 2303 33554432000 4194304 4785740 140734419629392 18446744073709551615 4546229 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 4974 2303 340 145 0 2019 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=6.33 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 633 0 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 9771297 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=8636 CPUtime=12.69 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 2345 0 0 0 1269 0 0 0 25 0 1 0 521306899 8843264 1329 33554432000 4194304 4352236 140736858197104 18446744073709551615 4328035 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 2159 1329 127 39 0 1239 0
[pid=15602] ppid=15597 vsize=21328 CPUtime=6.3 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 5097 0 0 0 629 1 0 0 25 0 1 0 521306899 21839872 2315 33554432000 4194304 4331988 140735178023808 18446744073709551615 4247582 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 5332 2315 175 34 0 3774 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 2202764

[startup+25.5004 s]
/proc/loadavg: 4.99 5.05 5.84 6/177 15604
/proc/meminfo: memFree=23038596/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1689076 CPUtime=25.49 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 12737 0 0 0 2546 3 0 0 25 0 1 0 521306899 1729613824 5695 33554432000 4194304 4587354 140734126595104 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 422269 5695 339 96 0 418831 0
[pid=15599] ppid=15597 vsize=21232 CPUtime=25.49 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 2890 0 0 0 2549 0 0 0 25 0 1 0 521306899 21741568 2655 33554432000 4194304 4785740 140734419629392 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 5308 2655 340 145 0 2353 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=12.72 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 1272 0 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134530227 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=8392 CPUtime=25.49 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 3688 0 0 0 2549 0 0 0 25 0 1 0 521306899 8593408 1298 33554432000 4194304 4352236 140736858197104 18446744073709551615 4329024 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 2098 1298 127 39 0 1178 0
[pid=15602] ppid=15597 vsize=24824 CPUtime=12.65 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 5654 0 0 0 1264 1 0 0 25 0 1 0 521306899 25419776 2872 33554432000 4194304 4331988 140735178023808 18446744073709551615 4246712 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 6206 2872 175 34 0 4648 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 2218600

[startup+51.1006 s]
/proc/loadavg: 4.99 5.04 5.81 6/177 15604
/proc/meminfo: memFree=23020676/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1699552 CPUtime=51.08 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 14778 0 0 0 5105 3 0 0 25 0 1 0 521306899 1740341248 7698 33554432000 4194304 4587354 140734126595104 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 424888 7699 339 96 0 421450 0
[pid=15599] ppid=15597 vsize=24676 CPUtime=51.09 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 3701 0 0 0 5109 0 0 0 25 0 1 0 521306899 25268224 3466 33554432000 4194304 4785740 140734419629392 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 6169 3466 340 145 0 3214 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=25.44 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 2544 0 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=11072 CPUtime=51.08 cores=2

################
# More data... #
################

/proc/15602/statm: 55687 37946 175 34 0 54129 0
Current children cumulated CPU time (s) 3524.76
Current children cumulated vsize (KiB) 2488592

[startup+942.301 s]
/proc/loadavg: 5.07 5.09 5.35 6/177 15628
/proc/meminfo: memFree=22783408/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1752568 CPUtime=942.31 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 142738 0 0 0 94179 52 0 0 25 0 1 0 521306899 1794629632 24613 33554432000 4194304 4587354 140734126595104 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 438142 24613 339 96 0 434704 0
[pid=15599] ppid=15597 vsize=42844 CPUtime=942.32 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 8173 0 0 0 94231 1 0 0 25 0 1 0 521306899 43872256 7938 33554432000 4194304 4785740 140734419629392 18446744073709551615 4562640 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 10711 7938 340 145 0 7756 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=468.75 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 46875 0 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=17240 CPUtime=942.32 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 47884 0 0 0 94226 6 0 0 25 0 1 0 521306899 17653760 3510 33554432000 4194304 4352236 140736858197104 18446744073709551615 4328345 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 4310 3510 127 39 0 3390 0
[pid=15602] ppid=15597 vsize=222880 CPUtime=468.73 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 42718 0 0 0 46853 20 0 0 25 0 1 0 521306899 228229120 39936 33554432000 4194304 4331988 140735178023808 18446744073709551615 4228257 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 55720 39936 175 34 0 54162 0
Current children cumulated CPU time (s) 3764.43
Current children cumulated vsize (KiB) 2510608

[startup+1002.3 s]
/proc/loadavg: 5.07 5.08 5.33 6/177 15630
/proc/meminfo: memFree=22767152/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1753648 CPUtime=1002.32 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 143453 0 0 0 100179 53 0 0 25 0 1 0 521306899 1795735552 25305 33554432000 4194304 4587354 140734126595104 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 438412 25305 339 96 0 434974 0
[pid=15599] ppid=15597 vsize=43348 CPUtime=1002.32 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 8261 0 0 0 100231 1 0 0 25 0 1 0 521306899 44388352 8026 33554432000 4194304 4785740 140734419629392 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 10837 8026 340 145 0 7882 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=498.63 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 49863 0 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=21592 CPUtime=1002.32 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 50220 0 0 0 100226 6 0 0 25 0 1 0 521306899 22110208 4598 33554432000 4194304 4352236 140736858197104 18446744073709551615 4231179 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 5398 4598 127 39 0 4478 0
[pid=15602] ppid=15597 vsize=223012 CPUtime=498.52 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 44961 0 0 0 49831 21 0 0 25 0 1 0 521306899 228364288 42179 33554432000 4194304 4331988 140735178023808 18446744073709551615 4226242 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 55753 42179 175 34 0 54195 0
Current children cumulated CPU time (s) 4004.11
Current children cumulated vsize (KiB) 2516676

[startup+1062.3 s]
/proc/loadavg: 5.06 5.08 5.31 6/177 15631
/proc/meminfo: memFree=22754112/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1751652 CPUtime=1062.32 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 143455 0 0 0 106179 53 0 0 25 0 1 0 521306899 1793691648 25305 33554432000 4194304 4587354 140734126595104 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 437913 25305 339 96 0 434475 0
[pid=15599] ppid=15597 vsize=43560 CPUtime=1062.32 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 8306 0 0 0 106231 1 0 0 25 0 1 0 521306899 44605440 8071 33554432000 4194304 4785740 140734419629392 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 10890 8071 340 145 0 7935 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=528.44 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 52843 1 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=25304 CPUtime=1062.32 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 52236 0 0 0 106226 6 0 0 25 0 1 0 521306899 25911296 5526 33554432000 4194304 4352236 140736858197104 18446744073709551615 4328087 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 6326 5526 127 39 0 5406 0
[pid=15602] ppid=15597 vsize=223144 CPUtime=528.41 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 47358 0 0 0 52818 23 0 0 25 0 1 0 521306899 228499456 44576 33554432000 4194304 4331988 140735178023808 18446744073709551615 4299577 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 55786 44576 175 34 0 54228 0
Current children cumulated CPU time (s) 4243.81
Current children cumulated vsize (KiB) 2518736

[startup+1122.3 s]
/proc/loadavg: 5.14 5.10 5.30 6/177 15633
/proc/meminfo: memFree=22747024/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1752756 CPUtime=1122.33 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 143457 0 0 0 112180 53 0 0 25 0 1 0 521306899 1794822144 25305 33554432000 4194304 4587354 140734126595104 18446744073709551615 4239308 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 438189 25305 339 96 0 434751 0
[pid=15599] ppid=15597 vsize=46220 CPUtime=1122.33 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 8974 0 0 0 112232 1 0 0 25 0 1 0 521306899 47329280 8739 33554432000 4194304 4785740 140734419629392 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 11555 8739 340 145 0 8600 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=558.32 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 55831 1 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=22360 CPUtime=1122.33 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 54732 0 0 0 112226 7 0 0 25 0 1 0 521306899 22896640 4790 33554432000 4194304 4352236 140736858197104 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 5590 4790 127 39 0 4670 0
[pid=15602] ppid=15597 vsize=223276 CPUtime=558.21 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 49194 0 0 0 55798 23 0 0 25 0 1 0 521306899 228634624 46412 33554432000 4194304 4331988 140735178023808 18446744073709551615 4228331 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 55819 46412 175 34 0 54261 0
Current children cumulated CPU time (s) 4483.52
Current children cumulated vsize (KiB) 2519688

[startup+1182.3 s]
/proc/loadavg: 5.12 5.09 5.28 6/177 15634
/proc/meminfo: memFree=22740180/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=115792 CPUtime=1182.33 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 143457 0 0 0 118180 53 0 0 25 0 1 0 521306899 118571008 25304 33554432000 4194304 4587354 140734126595104 18446744073709551615 4243380 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 28948 25304 339 96 0 25510 0
[pid=15599] ppid=15597 vsize=46424 CPUtime=1182.32 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 9004 0 0 0 118231 1 0 0 25 0 1 0 521306899 47538176 8769 33554432000 4194304 4785740 140734419629392 18446744073709551615 4287129 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 11606 8769 340 145 0 8651 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=588.13 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 58812 1 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=21336 CPUtime=1182.33 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 55532 0 0 0 118226 7 0 0 25 0 1 0 521306899 21848064 4534 33554432000 4194304 4352236 140736858197104 18446744073709551615 4329349 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 5334 4534 127 39 0 4414 0
[pid=15602] ppid=15597 vsize=232140 CPUtime=588.08 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 51150 0 0 0 58783 25 0 0 25 0 1 0 521306899 237711360 48368 33554432000 4194304 4331988 140735178023808 18446744073709551615 4237195 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 58035 48368 175 34 0 56477 0
Current children cumulated CPU time (s) 4723.19
Current children cumulated vsize (KiB) 890768



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.61 s]
/proc/loadavg: 5.15 5.10 5.28 7/177 15635
/proc/meminfo: memFree=22732988/32951124 swapFree=67111524/67111528
[pid=15597] ppid=15595 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15597/stat : 15597 (ppfolio) S 15595 15597 14150 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 521306899 18763776 390 33554432000 4194304 4287625 140735523968208 18446744073709551615 244446965263 0 0 4096 65536 4600699839976570879 0 0 17 4 0 0 0
/proc/15597/statm: 4581 390 341 23 0 91 0
[pid=15598] ppid=15597 vsize=1751620 CPUtime=1201.64 cores=0
/proc/15598/stat : 15598 (cryptominisat) R 15597 15597 14150 0 -1 4202496 143458 0 0 0 120111 53 0 0 25 0 1 0 521306899 1793658880 25305 33554432000 4194304 4587354 140734126595104 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15598/statm: 437905 25305 339 96 0 434467 0
[pid=15599] ppid=15597 vsize=46424 CPUtime=1201.64 cores=4
/proc/15599/stat : 15599 (clasp) R 15597 15597 14150 0 -1 4202496 9032 0 0 0 120163 1 0 0 25 0 1 0 521306899 47538176 8797 33554432000 4194304 4785740 140734419629392 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/15599/statm: 11606 8797 340 145 0 8651 0
[pid=15600] ppid=15597 vsize=456752 CPUtime=597.73 cores=6
/proc/15600/stat : 15600 (TNM) R 15597 15597 14150 0 -1 4202496 770 0 0 0 59772 1 0 0 25 0 1 0 521306899 467714048 666 33554432000 134512640 134534564 4292053568 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15600/statm: 114188 666 95 6 0 112854 0
[pid=15601] ppid=15597 vsize=25304 CPUtime=1201.64 cores=2
/proc/15601/stat : 15601 (lingeling) R 15597 15597 14150 0 -1 4202496 56524 0 0 0 120157 7 0 0 25 0 1 0 521306899 25911296 5526 33554432000 4194304 4352236 140736858197104 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/15601/statm: 6326 5526 127 39 0 5406 0
[pid=15602] ppid=15597 vsize=232140 CPUtime=597.68 cores=6
/proc/15602/stat : 15602 (march_hi) R 15597 15597 14150 0 -1 4202496 51845 0 0 0 59743 25 0 0 25 0 1 0 521306899 237711360 49063 33554432000 4194304 4331988 140735178023808 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/15602/statm: 58035 49063 175 34 0 56477 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 2530564

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15597 and gives
#  childrusage.ru_utime.tv_sec=2403
#  childrusage.ru_utime.tv_usec=209656
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=99984
# CPU time returned by wait4() is 2403.31
# while last known CPU time is 4800.33
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.62
CPU time (s): 4800.33
CPU user time (s): 4799.46
CPU system time (s): 0.87
CPU usage (%): 399.489
Max. virtual memory (cumulated for all children) (KiB): 4152168

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2403.21
system time used= 0.099984
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 66097
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 730
involuntary context switches= 3874

runsolver used 2.10468 second user time and 4.12337 second system time

The end

Launcher Data 

Begin job on node105 at 2011-04-29 19:11:05
IDJOB=3266441
IDBENCH=87734
IDSOLVER=1612
FILE ID=node105/3266441-1304097065
RUNJOBID= node105-1304087809-14168
PBS_JOBID= 13170561
Free space on /tmp= 71940 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT02/handmade/simon/satex-challenges/c6288.shuffled.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3266441-1304097065/watcher-3266441-1304097065 -o /tmp/evaluation-result-3266441-1304097065/solver-3266441-1304097065 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3266441-1304097065.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 75bd8319132b47c2d2e6f0889735a248
RANDOM SEED=463706101

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23087508 kB
Buffers:       2157136 kB
Cached:        7096672 kB
SwapCached:          4 kB
Active:         548852 kB
Inactive:      8768256 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23087508 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           10188 kB
Writeback:          32 kB
AnonPages:       62992 kB
Mapped:          14264 kB
Slab:           484076 kB
PageTables:       4484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186728 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71928 MiB
End job on node105 at 2011-04-29 19:31:08