Trace number 3250555

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.32 1201.71

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-17_279.cnf
MD5SUMd2562f4e152a54a992ab300a2bacfba9
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables279
Number of clauses21616
Sum of the clauses size96978
Maximum clause length17
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 319321
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52295

Solver Data 

0.00/0.03	This is pico-portfolio, a naive parallel portfolio
0.00/0.03	Copyright (C) 2011 Olivier Roussel
0.00/0.03	Using 4 processing units
0.00/0.03	This portfolio uses the following solvers:
0.00/0.03	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.03	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.03	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.03	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.03	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.03	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.03	Starting clasp 1.3.6 on core(s) 5
0.00/0.03	Starting TNM 2009 on core(s) 7
0.00/0.03	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.03	Starting march_hi 2009 on core(s) 7
4800.32/1201.71	Done

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3250555-1304086960/watcher-3250555-1304086960 -o /tmp/evaluation-result-3250555-1304086960/solver-3250555-1304086960 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3250555-1304086960.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.22 9.18 9.19 5/181 2153
/proc/meminfo: memFree=20631236/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) R 2151 2153 567 0 -1 4194304 495 0 0 0 0 0 0 0 25 0 1 0 598926657 18763776 388 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895310741 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/2153/statm: 4581 388 339 23 0 91 0

[startup+0.0380669 s]
/proc/loadavg: 9.22 9.18 9.19 5/181 2153
/proc/meminfo: memFree=20631236/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101056 s]
/proc/loadavg: 9.22 9.18 9.19 5/181 2153
/proc/meminfo: memFree=20631236/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) R 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301018 s]
/proc/loadavg: 9.22 9.18 9.19 5/181 2153
/proc/meminfo: memFree=20631236/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 24 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700941 s]
/proc/loadavg: 9.22 9.18 9.19 5/181 2153
/proc/meminfo: memFree=20631236/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 20 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5008 s]
/proc/loadavg: 9.22 9.18 9.19 10/187 2159
/proc/meminfo: memFree=20608828/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 18 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1663220 CPUtime=1.48 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 3474 0 0 0 148 0 0 0 20 0 1 0 598926658 1703137280 1773 33554432000 4194304 4587354 140734160806464 18446744073709551615 4241244 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 415805 1773 327 96 0 412367 0
[pid=2155] ppid=2153 vsize=16580 CPUtime=1.49 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 1669 0 0 0 149 0 0 0 25 0 1 0 598926658 16977920 1481 33554432000 4194304 4785740 140737284873088 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 4145 1481 340 145 0 1190 0
[pid=2156] ppid=2153 vsize=454108 CPUtime=0.78 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1007 0 0 0 78 0 0 0 25 0 1 0 598926658 465006592 904 33554432000 134512640 134534564 4291995424 18446744073709551615 134530353 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 113527 904 95 6 0 112193 0
[pid=2157] ppid=2153 vsize=8552 CPUtime=1.49 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 1685 0 0 0 149 0 0 0 25 0 1 0 598926658 8757248 1329 33554432000 4194304 4352236 140735340796928 18446744073709551615 4328191 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 2138 1329 127 39 0 1218 0
[pid=2158] ppid=2153 vsize=14024 CPUtime=0.7 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 3596 0 0 0 70 0 0 0 25 0 1 0 598926658 14360576 1683 33554432000 4194304 4331988 140734879951936 18446744073709551615 4226642 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 3506 1683 151 34 0 1948 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 2174808

[startup+3.1005 s]
/proc/loadavg: 9.22 9.18 9.19 10/187 2159
/proc/meminfo: memFree=20601884/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1675128 CPUtime=3.09 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 6657 0 0 0 308 1 0 0 25 0 1 0 598926658 1715331072 4360 33554432000 4194304 4587354 140734160806464 18446744073709551615 4238770 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 418782 4360 337 96 0 415344 0
[pid=2155] ppid=2153 vsize=17712 CPUtime=3.09 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 1955 0 0 0 309 0 0 0 25 0 1 0 598926658 18137088 1767 33554432000 4194304 4785740 140737284873088 18446744073709551615 4287249 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 4428 1767 340 145 0 1473 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=1.57 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 157 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134528310 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=9320 CPUtime=3.09 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 1848 0 0 0 309 0 0 0 25 0 1 0 598926658 9543680 1492 33554432000 4194304 4352236 140735340796928 18446744073709551615 4271292 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 2330 1492 127 39 0 1410 0
[pid=2158] ppid=2153 vsize=14952 CPUtime=1.5 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 4659 0 0 0 150 0 0 0 25 0 1 0 598926658 15310848 2082 33554432000 4194304 4331988 140734879951936 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 3738 2082 175 34 0 2180 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 2193380

[startup+6.3009 s]
/proc/loadavg: 9.20 9.18 9.19 10/187 2159
/proc/meminfo: memFree=20588900/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1674900 CPUtime=6.29 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 9106 0 0 0 628 1 0 0 25 0 1 0 598926658 1715097600 4669 33554432000 4194304 4587354 140734160806464 18446744073709551615 4270385 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 418725 4669 337 96 0 415287 0
[pid=2155] ppid=2153 vsize=19336 CPUtime=6.29 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 2336 0 0 0 629 0 0 0 25 0 1 0 598926658 19800064 2148 33554432000 4194304 4785740 140737284873088 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 4834 2148 340 145 0 1879 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=3.15 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 315 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=12136 CPUtime=6.29 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 2581 0 0 0 629 0 0 0 25 0 1 0 598926658 12427264 2225 33554432000 4194304 4352236 140735340796928 18446744073709551615 4328351 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 3034 2225 127 39 0 2114 0
[pid=2158] ppid=2153 vsize=14952 CPUtime=3.1 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 4659 0 0 0 310 0 0 0 25 0 1 0 598926658 15310848 2082 33554432000 4194304 4331988 140734879951936 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 3738 2082 175 34 0 2180 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 2197592

[startup+12.7007 s]
/proc/loadavg: 9.19 9.18 9.19 10/187 2159
/proc/meminfo: memFree=20574904/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1683956 CPUtime=12.69 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 14599 0 0 0 1267 2 0 0 25 0 1 0 598926658 1724370944 6534 33554432000 4194304 4587354 140734160806464 18446744073709551615 4238190 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 420989 6534 337 96 0 417551 0
[pid=2155] ppid=2153 vsize=21520 CPUtime=12.69 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 2877 0 0 0 1269 0 0 0 25 0 1 0 598926658 22036480 2689 33554432000 4194304 4785740 140737284873088 18446744073709551615 4287096 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 5380 2689 340 145 0 2425 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=6.32 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 632 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134528396 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=13532 CPUtime=12.69 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 2901 0 0 0 1269 0 0 0 25 0 1 0 598926658 13856768 2545 33554432000 4194304 4352236 140735340796928 18446744073709551615 4328336 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 3383 2545 127 39 0 2463 0
[pid=2158] ppid=2153 vsize=14952 CPUtime=6.3 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 4659 0 0 0 630 0 0 0 25 0 1 0 598926658 15310848 2082 33554432000 4194304 4331988 140734879951936 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 3738 2082 175 34 0 2180 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 2210228

[startup+25.5013 s]
/proc/loadavg: 9.14 9.17 9.19 10/187 2159
/proc/meminfo: memFree=20569816/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1686964 CPUtime=25.49 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 22837 0 0 0 2546 3 0 0 25 0 1 0 598926658 1727451136 6466 33554432000 4194304 4587354 140734160806464 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 421741 6466 337 96 0 418303 0
[pid=2155] ppid=2153 vsize=24568 CPUtime=25.49 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 3547 0 0 0 2549 0 0 0 25 0 1 0 598926658 25157632 3359 33554432000 4194304 4785740 140737284873088 18446744073709551615 4287207 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 6142 3359 340 145 0 3187 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=12.72 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 1272 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134530204 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=14956 CPUtime=25.48 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 4153 0 0 0 2548 0 0 0 25 0 1 0 598926658 15314944 2901 33554432000 4194304 4352236 140735340796928 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 3739 2901 127 39 0 2819 0
[pid=2158] ppid=2153 vsize=14952 CPUtime=12.63 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 4659 0 0 0 1263 0 0 0 25 0 1 0 598926658 15310848 2082 33554432000 4194304 4331988 140734879951936 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 3738 2082 175 34 0 2180 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 2217708

[startup+51.1005 s]
/proc/loadavg: 9.28 9.20 9.19 10/187 2160
/proc/meminfo: memFree=20564840/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1676696 CPUtime=51.09 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 39097 0 0 0 5102 7 0 0 25 0 1 0 598926658 1716936704 5912 33554432000 4194304 4587354 140734160806464 18446744073709551615 4241101 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 419174 5912 337 96 0 415736 0
[pid=2155] ppid=2153 vsize=28640 CPUtime=51.09 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 4518 0 0 0 5109 0 0 0 25 0 1 0 598926658 29327360 4330 33554432000 4194304 4785740 140737284873088 18446744073709551615 4287194 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 7160 4330 340 145 0 4205 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=25.42 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 2542 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=17008 CPUtime=51.08 cores=3

################
# More data... #
################

/proc/2158/statm: 6334 3915 175 34 0 4776 0
Current children cumulated CPU time (s) 3764.1
Current children cumulated vsize (KiB) 2321176

[startup+1002.3 s]
/proc/loadavg: 5.32 7.35 8.46 6/177 2206
/proc/meminfo: memFree=20568640/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 1 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1721828 CPUtime=1002.32 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 267334 0 0 0 100148 84 0 0 25 0 1 0 598926658 1763151872 16640 33554432000 4194304 4587354 140734160806464 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 430457 16640 337 96 0 427019 0
[pid=2155] ppid=2153 vsize=62656 CPUtime=1002.31 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 12789 0 0 0 100229 2 0 0 25 0 1 0 598926658 64159744 11926 33554432000 4194304 4785740 140737284873088 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 15664 11926 341 145 0 12709 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=498.44 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 49844 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=49796 CPUtime=1002.31 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 119234 0 0 0 100214 17 0 0 25 0 1 0 598926658 50991104 11611 33554432000 4194304 4352236 140735340796928 18446744073709551615 4207636 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 12449 11611 127 39 0 11529 0
[pid=2158] ppid=2153 vsize=25336 CPUtime=498.38 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 7040 0 0 0 49837 1 0 0 25 0 1 0 598926658 25944064 4024 33554432000 4194304 4331988 140734879951936 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 6334 4024 175 34 0 4776 0
Current children cumulated CPU time (s) 4003.77
Current children cumulated vsize (KiB) 2335884

[startup+1062.3 s]
/proc/loadavg: 5.17 6.93 8.25 6/177 2208
/proc/meminfo: memFree=20571124/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 1 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=81484 CPUtime=1062.32 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 282466 0 0 0 106140 92 0 0 25 0 1 0 598926658 83439616 15344 33554432000 4194304 4587354 140734160806464 18446744073709551615 231895187092 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 20371 15344 337 96 0 16933 0
[pid=2155] ppid=2153 vsize=63228 CPUtime=1062.32 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 12937 0 0 0 106230 2 0 0 25 0 1 0 598926658 64745472 12074 33554432000 4194304 4785740 140737284873088 18446744073709551615 4553423 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 15807 12074 341 145 0 12852 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=528.28 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 52828 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=42116 CPUtime=1062.31 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 123074 0 0 0 106214 17 0 0 25 0 1 0 598926658 43126784 9691 33554432000 4194304 4352236 140735340796928 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 10529 9691 127 39 0 9609 0
[pid=2158] ppid=2153 vsize=25336 CPUtime=528.21 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 7152 0 0 0 52820 1 0 0 25 0 1 0 598926658 25944064 4136 33554432000 4194304 4331988 140734879951936 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 6334 4136 175 34 0 4776 0
Current children cumulated CPU time (s) 4243.45
Current children cumulated vsize (KiB) 688432

[startup+1122.3 s]
/proc/loadavg: 5.12 6.59 8.04 6/177 2210
/proc/meminfo: memFree=20569740/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 1 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1733876 CPUtime=1122.32 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 295315 0 0 0 112133 99 0 0 25 0 1 0 598926658 1775489024 16959 33554432000 4194304 4587354 140734160806464 18446744073709551615 4237490 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 433469 16959 337 96 0 430031 0
[pid=2155] ppid=2153 vsize=64508 CPUtime=1122.32 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 13210 0 0 0 112230 2 0 0 25 0 1 0 598926658 66056192 12347 33554432000 4194304 4785740 140737284873088 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 16127 12347 341 145 0 13172 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=558.13 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 55813 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=42116 CPUtime=1122.31 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 127042 0 0 0 112213 18 0 0 25 0 1 0 598926658 43126784 9691 33554432000 4194304 4352236 140735340796928 18446744073709551615 4328363 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 10529 9691 127 39 0 9609 0
[pid=2158] ppid=2153 vsize=25336 CPUtime=558.04 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 7266 0 0 0 55803 1 0 0 25 0 1 0 598926658 25944064 4250 33554432000 4194304 4331988 140734879951936 18446744073709551615 4237419 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 6334 4250 175 34 0 4776 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 2342104

[startup+1182.3 s]
/proc/loadavg: 5.09 6.32 7.86 6/177 2211
/proc/meminfo: memFree=20571940/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 1 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1710940 CPUtime=1182.33 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 314789 0 0 0 118128 105 0 0 25 0 1 0 598926658 1752002560 14910 33554432000 4194304 4587354 140734160806464 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 427735 14910 337 96 0 424297 0
[pid=2155] ppid=2153 vsize=65076 CPUtime=1182.32 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 13385 0 0 0 118230 2 0 0 25 0 1 0 598926658 66637824 12450 33554432000 4194304 4785740 140737284873088 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 16269 12450 341 145 0 13314 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=587.94 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 58794 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134530239 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=48244 CPUtime=1182.31 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 134462 0 0 0 118212 19 0 0 25 0 1 0 598926658 49401856 11223 33554432000 4194304 4352236 140735340796928 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 12061 11223 127 39 0 11141 0
[pid=2158] ppid=2153 vsize=25336 CPUtime=587.9 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 7376 0 0 0 58789 1 0 0 25 0 1 0 598926658 25944064 4360 33554432000 4194304 4331988 140734879951936 18446744073709551615 4239596 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 6334 4360 175 34 0 4776 0
Current children cumulated CPU time (s) 4722.81
Current children cumulated vsize (KiB) 2325864



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 5.06 6.23 7.79 6/177 2212
/proc/meminfo: memFree=20571184/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 1 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1707884 CPUtime=1201.73 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 319753 0 0 0 120066 107 0 0 25 0 1 0 598926658 1748873216 14079 33554432000 4194304 4587354 140734160806464 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 426971 14079 337 96 0 423533 0
[pid=2155] ppid=2153 vsize=65076 CPUtime=1201.72 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 13394 0 0 0 120170 2 0 0 25 0 1 0 598926658 66637824 12459 33554432000 4194304 4785740 140737284873088 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 16269 12459 341 145 0 13314 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=597.63 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 59763 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134528891 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=51316 CPUtime=1201.72 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 137278 0 0 0 120152 20 0 0 25 0 1 0 598926658 52547584 11991 33554432000 4194304 4352236 140735340796928 18446744073709551615 4328016 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 12829 11991 127 39 0 11909 0
[pid=2158] ppid=2153 vsize=25336 CPUtime=597.51 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 7410 0 0 0 59750 1 0 0 25 0 1 0 598926658 25944064 4394 33554432000 4194304 4331988 140734879951936 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 6334 4394 175 34 0 4776 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 2325880

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 5.06 6.23 7.79 6/177 2212
/proc/meminfo: memFree=20571184/32950928 swapFree=67111524/67111528
[pid=2153] ppid=2151 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/2153/stat : 2153 (ppfolio) S 2151 2153 567 0 -1 4202496 524 0 0 0 0 1 0 0 15 0 1 0 598926657 18763776 390 33554432000 4194304 4287625 140735333720688 18446744073709551615 231895510543 0 0 4096 65536 11434534454828204031 0 0 17 3 0 0 0
/proc/2153/statm: 4581 390 341 23 0 91 0
[pid=2154] ppid=2153 vsize=1707884 CPUtime=1201.73 cores=1
/proc/2154/stat : 2154 (cryptominisat) R 2153 2153 567 0 -1 4202496 319753 0 0 0 120066 107 0 0 25 0 1 0 598926658 1748873216 14079 33554432000 4194304 4587354 140734160806464 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2154/statm: 426971 14079 337 96 0 423533 0
[pid=2155] ppid=2153 vsize=65076 CPUtime=1201.72 cores=5
/proc/2155/stat : 2155 (clasp) R 2153 2153 567 0 -1 4202496 13394 0 0 0 120170 2 0 0 25 0 1 0 598926658 66637824 12459 33554432000 4194304 4785740 140737284873088 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/2155/statm: 16269 12459 341 145 0 13314 0
[pid=2156] ppid=2153 vsize=457944 CPUtime=597.63 cores=7
/proc/2156/stat : 2156 (TNM) R 2153 2153 567 0 -1 4202496 1008 0 0 0 59763 0 0 0 25 0 1 0 598926658 468934656 905 33554432000 134512640 134534564 4291995424 18446744073709551615 134528891 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2156/statm: 114486 905 95 6 0 113152 0
[pid=2157] ppid=2153 vsize=51316 CPUtime=1201.72 cores=3
/proc/2157/stat : 2157 (lingeling) R 2153 2153 567 0 -1 4202496 137278 0 0 0 120152 20 0 0 25 0 1 0 598926658 52547584 11991 33554432000 4194304 4352236 140735340796928 18446744073709551615 4328016 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/2157/statm: 12829 11991 127 39 0 11909 0
[pid=2158] ppid=2153 vsize=25336 CPUtime=597.51 cores=7
/proc/2158/stat : 2158 (march_hi) R 2153 2153 567 0 -1 4202496 7410 0 0 0 59750 1 0 0 25 0 1 0 598926658 25944064 4394 33554432000 4194304 4331988 140734879951936 18446744073709551615 4210416 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/2158/statm: 6334 4394 175 34 0 4776 0
Current children cumulated CPU time (s) 4800.32
Current children cumulated vsize (KiB) 2325880

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2153 and gives
#  childrusage.ru_utime.tv_sec=4201
#  childrusage.ru_utime.tv_usec=546267
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=335796
# CPU time returned by wait4() is 4202.88
# while last known CPU time is 4800.32
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.32
CPU user time (s): 4799.01
CPU system time (s): 1.31
CPU usage (%): 399.457
Max. virtual memory (cumulated for all children) (KiB): 3969892

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4201.55
system time used= 1.3358
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 471991
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 446
involuntary context switches= 20102

runsolver used 1.78873 second user time and 4.77127 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 16:22:40
IDJOB=3250555
IDBENCH=83320
IDSOLVER=1612
FILE ID=node114/3250555-1304086960
RUNJOBID= node114-1304077601-586
PBS_JOBID= 13170509
Free space on /tmp= 71792 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-17_279.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3250555-1304086960/watcher-3250555-1304086960 -o /tmp/evaluation-result-3250555-1304086960/solver-3250555-1304086960 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3250555-1304086960.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2562f4e152a54a992ab300a2bacfba9
RANDOM SEED=349065531

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20631392 kB
Buffers:       2223640 kB
Cached:        9350272 kB
SwapCached:          4 kB
Active:        2951072 kB
Inactive:      8788284 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20631392 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           10636 kB
Writeback:           0 kB
AnonPages:      165188 kB
Mapped:          16444 kB
Slab:           516276 kB
PageTables:       4848 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   766016 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71796 MiB
End job on node114 at 2011-04-29 16:42:42