Trace number 3190895

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.22 1201.71

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S894356234-063-UNKNOWN.cnf
MD5SUMc26a52ff3714cab8bc335a81bb8af922
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.00/0.80	This is pico-portfolio, a naive parallel portfolio
0.00/0.80	Copyright (C) 2011 Olivier Roussel
0.00/0.80	Using 4 processing units
0.00/0.80	This portfolio uses the following solvers:
0.00/0.80	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.80	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.80	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.80	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.80	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.80	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.80	Starting clasp 1.3.6 on core(s) 4
0.00/0.80	Starting TNM 2009 on core(s) 6
0.00/0.80	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.80	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3190895-1304042646/watcher-3190895-1304042646 -o /tmp/evaluation-result-3190895-1304042646/solver-3190895-1304042646 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3190895-1304042646.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.94 5.33 6.10 6/182 30253
/proc/meminfo: memFree=21328600/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0

[startup+0.466735 s]
/proc/loadavg: 5.94 5.33 6.10 6/182 30253
/proc/meminfo: memFree=21328600/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 22 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.566718 s]
/proc/loadavg: 5.94 5.33 6.10 6/182 30253
/proc/meminfo: memFree=21328600/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 18 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.600713 s]
/proc/loadavg: 5.94 5.33 6.10 6/182 30253
/proc/meminfo: memFree=21328600/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 17 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700695 s]
/proc/loadavg: 5.94 5.33 6.10 6/182 30253
/proc/meminfo: memFree=21328600/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 17 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50655 s]
/proc/loadavg: 5.94 5.33 6.10 11/188 30259
/proc/meminfo: memFree=21303504/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1918776 CPUtime=1.49 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 4999 0 0 0 149 0 0 0 20 0 1 0 248455889 1964826624 2143 33554432000 4194304 4587354 140736515337248 18446744073709551615 4241083 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 479694 2143 327 96 0 476256 0
[pid=30255] ppid=30253 vsize=19780 CPUtime=1.49 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 2457 0 0 0 149 0 0 0 25 0 1 0 248455889 20254720 2268 33554432000 4194304 4785740 140733195786832 18446744073709551615 4286927 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 4945 2268 340 145 0 1990 0
[pid=30256] ppid=30253 vsize=454504 CPUtime=0.78 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 997 0 0 0 78 0 0 0 25 0 1 0 248455889 465412096 893 33554432000 134512640 134534564 4289742240 18446744073709551615 134524700 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 113626 893 91 6 0 112292 0
[pid=30257] ppid=30253 vsize=6984 CPUtime=1.5 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 1668 0 0 0 150 0 0 0 25 0 1 0 248455889 7151616 916 33554432000 4194304 4352236 140734516837120 18446744073709551615 4231417 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 1746 916 127 39 0 826 0
[pid=30258] ppid=30253 vsize=10204 CPUtime=0.7 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 3931 0 0 0 70 0 0 0 25 0 1 0 248455889 10448896 918 33554432000 4194304 4331988 140734505465616 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 2551 918 150 34 0 993 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 2428572

[startup+3.10128 s]
/proc/loadavg: 5.94 5.33 6.10 11/188 30259
/proc/meminfo: memFree=21298632/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=9323600 CPUtime=3.09 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 10482 0 0 0 308 1 0 0 25 0 1 0 248455889 9547366400 5783 33554432000 4194304 4587354 140736515337248 18446744073709551615 4388352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 2330900 5783 337 96 0 2327462 0
[pid=30255] ppid=30253 vsize=21316 CPUtime=3.09 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 2838 0 0 0 309 0 0 0 25 0 1 0 248455889 21827584 2649 33554432000 4194304 4785740 140733195786832 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 5329 2649 340 145 0 2374 0
[pid=30256] ppid=30253 vsize=454504 CPUtime=1.57 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 997 0 0 0 157 0 0 0 25 0 1 0 248455889 465412096 893 33554432000 134512640 134534564 4289742240 18446744073709551615 134524554 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 113626 893 91 6 0 112292 0
[pid=30257] ppid=30253 vsize=7692 CPUtime=3.09 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 1845 0 0 0 309 0 0 0 25 0 1 0 248455889 7876608 1093 33554432000 4194304 4352236 140734516837120 18446744073709551615 4328039 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 1923 1093 127 39 0 1003 0
[pid=30258] ppid=30253 vsize=10204 CPUtime=1.5 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 3931 0 0 0 150 0 0 0 25 0 1 0 248455889 10448896 918 33554432000 4194304 4331988 140734505465616 18446744073709551615 4271154 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 2551 918 150 34 0 993 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 9835640

[startup+6.30071 s]
/proc/loadavg: 6.26 5.41 6.12 11/188 30259
/proc/meminfo: memFree=21275976/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1931600 CPUtime=6.28 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 11806 0 0 0 627 1 0 0 25 0 1 0 248455889 1977958400 6024 33554432000 4194304 4587354 140736515337248 18446744073709551615 4388352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 482900 6024 337 96 0 479462 0
[pid=30255] ppid=30253 vsize=23740 CPUtime=6.29 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 3424 0 0 0 629 0 0 0 25 0 1 0 248455889 24309760 3235 33554432000 4194304 4785740 140733195786832 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 5935 3235 340 145 0 2980 0
[pid=30256] ppid=30253 vsize=454504 CPUtime=3.15 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 997 0 0 0 315 0 0 0 25 0 1 0 248455889 465412096 893 33554432000 134512640 134534564 4289742240 18446744073709551615 134524546 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 113626 893 91 6 0 112292 0
[pid=30257] ppid=30253 vsize=8596 CPUtime=6.29 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 2079 0 0 0 629 0 0 0 25 0 1 0 248455889 8802304 1327 33554432000 4194304 4352236 140734516837120 18446744073709551615 4267888 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 2149 1327 127 39 0 1229 0
[pid=30258] ppid=30253 vsize=13112 CPUtime=3.1 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 4802 0 0 0 310 0 0 0 25 0 1 0 248455889 13426688 1476 33554432000 4194304 4331988 140734505465616 18446744073709551615 4246241 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 3278 1476 174 34 0 1720 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 2449876

[startup+12.7006 s]
/proc/loadavg: 6.56 5.48 6.14 11/188 30260
/proc/meminfo: memFree=21299324/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1919912 CPUtime=12.69 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 13921 0 0 0 1267 2 0 0 25 0 1 0 248455889 1965989888 5497 33554432000 4194304 4587354 140736515337248 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 479978 5497 337 96 0 476540 0
[pid=30255] ppid=30253 vsize=27068 CPUtime=12.68 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 4203 0 0 0 1268 0 0 0 25 0 1 0 248455889 27717632 4014 33554432000 4194304 4785740 140733195786832 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 6767 4014 340 145 0 3812 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=6.34 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 634 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134530476 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=7960 CPUtime=12.69 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 2704 0 0 0 1269 0 0 0 25 0 1 0 248455889 8151040 1184 33554432000 4194304 4352236 140734516837120 18446744073709551615 4328087 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 1990 1184 127 39 0 1070 0
[pid=30258] ppid=30253 vsize=13112 CPUtime=6.27 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 4802 0 0 0 627 0 0 0 25 0 1 0 248455889 13426688 1476 33554432000 4194304 4331988 140734505465616 18446744073709551615 4265345 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 3278 1476 174 34 0 1720 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 2444980

[startup+25.5003 s]
/proc/loadavg: 7.32 5.70 6.20 11/188 30260
/proc/meminfo: memFree=21258548/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1917480 CPUtime=25.49 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 23170 0 0 0 2545 4 0 0 25 0 1 0 248455889 1963499520 3348 33554432000 4194304 4587354 140736515337248 18446744073709551615 4238406 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 479370 3348 337 96 0 475932 0
[pid=30255] ppid=30253 vsize=31524 CPUtime=25.49 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 5210 0 0 0 2548 1 0 0 25 0 1 0 248455889 32280576 5021 33554432000 4194304 4785740 140733195786832 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 7881 5021 340 145 0 4926 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=12.74 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 1274 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=8344 CPUtime=25.48 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 4176 0 0 0 2548 0 0 0 25 0 1 0 248455889 8544256 1280 33554432000 4194304 4352236 140734516837120 18446744073709551615 4328304 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 2086 1280 127 39 0 1166 0
[pid=30258] ppid=30253 vsize=14648 CPUtime=12.61 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 5074 0 0 0 1261 0 0 0 25 0 1 0 248455889 14999552 1748 33554432000 4194304 4331988 140734505465616 18446744073709551615 4239578 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 3662 1748 174 34 0 2104 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 2448924

[startup+51.1009 s]
/proc/loadavg: 8.29 6.06 6.31 11/188 30260
/proc/meminfo: memFree=21197084/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1955440 CPUtime=51.09 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 48592 0 0 0 5102 7 0 0 25 0 1 0 248455889 2002370560 12728 33554432000 4194304 4587354 140736515337248 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 488860 12728 337 96 0 485422 0
[pid=30255] ppid=30253 vsize=37904 CPUtime=51.08 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 6691 0 0 0 5107 1 0 0 25 0 1 0 248455889 38813696 6502 33554432000 4194304 4785740 140733195786832 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 9476 6502 340 145 0 6521 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=25.44 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 2544 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=8604 CPUtime=51.09 cores=2

################
# More data... #
################

/proc/30258/statm: 18012 13671 175 34 0 16454 0
Current children cumulated CPU time (s) 3763.99
Current children cumulated vsize (KiB) 2610632

[startup+1002.3 s]
/proc/loadavg: 9.23 9.16 8.32 10/187 30286
/proc/meminfo: memFree=21040748/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1976756 CPUtime=1002.31 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 309212 0 0 0 100136 95 0 0 25 0 1 0 248455889 2024198144 13440 33554432000 4194304 4587354 140736515337248 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 494189 13440 337 96 0 490751 0
[pid=30255] ppid=30253 vsize=91016 CPUtime=1002.22 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 18880 0 0 0 100217 5 0 0 25 0 1 0 248455889 93200384 18410 33554432000 4194304 4785740 140733195786832 18446744073709551615 4278107 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 22754 18410 341 145 0 19799 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=498.47 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 49847 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134530522 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=19436 CPUtime=1002.31 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 44988 0 0 0 100226 5 0 0 25 0 1 0 248455889 19902464 4042 33554432000 4194304 4352236 140734516837120 18446744073709551615 4234450 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 4859 4042 127 39 0 3939 0
[pid=30258] ppid=30253 vsize=72048 CPUtime=498.37 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 17801 0 0 0 49831 6 0 0 25 0 1 0 248455889 73777152 14475 33554432000 4194304 4331988 140734505465616 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 18012 14475 175 34 0 16454 0
Current children cumulated CPU time (s) 4003.68
Current children cumulated vsize (KiB) 2636184

[startup+1062.3 s]
/proc/loadavg: 9.13 9.14 8.37 10/187 30288
/proc/meminfo: memFree=21024248/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=133300 CPUtime=1062.32 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 323609 0 0 0 106128 104 0 0 25 0 1 0 248455889 136499200 14437 33554432000 4194304 4587354 140736515337248 18446744073709551615 268660358850 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 33325 14437 337 96 0 29887 0
[pid=30255] ppid=30253 vsize=93596 CPUtime=1062.22 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 19516 0 0 0 106217 5 0 0 25 0 1 0 248455889 95842304 18965 33554432000 4194304 4785740 140733195786832 18446744073709551615 4287076 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 23399 18965 341 145 0 20444 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=528.29 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 52829 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134528697 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=19436 CPUtime=1062.31 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 45788 0 0 0 106225 6 0 0 25 0 1 0 248455889 19902464 4042 33554432000 4194304 4352236 140734516837120 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 4859 4042 127 39 0 3939 0
[pid=30258] ppid=30253 vsize=72048 CPUtime=528.22 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 18607 0 0 0 52815 7 0 0 25 0 1 0 248455889 73777152 15281 33554432000 4194304 4331988 140734505465616 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 18012 15281 175 34 0 16454 0
Current children cumulated CPU time (s) 4243.36
Current children cumulated vsize (KiB) 795308

[startup+1122.3 s]
/proc/loadavg: 9.24 9.18 8.43 10/187 30289
/proc/meminfo: memFree=21009108/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1969120 CPUtime=1122.32 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 337760 0 0 0 112122 110 0 0 25 0 1 0 248455889 2016378880 14868 33554432000 4194304 4587354 140736515337248 18446744073709551615 4238770 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 492280 14868 337 96 0 488842 0
[pid=30255] ppid=30253 vsize=95728 CPUtime=1122.22 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 20032 0 0 0 112217 5 0 0 25 0 1 0 248455889 98025472 19409 33554432000 4194304 4785740 140733195786832 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 23932 19409 341 145 0 20977 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=558.16 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 55816 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=19436 CPUtime=1122.32 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 46588 0 0 0 112226 6 0 0 25 0 1 0 248455889 19902464 4042 33554432000 4194304 4352236 140734516837120 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 4859 4042 127 39 0 3939 0
[pid=30258] ppid=30253 vsize=72048 CPUtime=558.03 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 19401 0 0 0 55796 7 0 0 25 0 1 0 248455889 73777152 16075 33554432000 4194304 4331988 140734505465616 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 18012 16075 175 34 0 16454 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 2633260

[startup+1182.3 s]
/proc/loadavg: 9.26 9.19 8.47 10/187 30291
/proc/meminfo: memFree=20997316/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1969792 CPUtime=1182.31 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 351631 0 0 0 118115 116 0 0 25 0 1 0 248455889 2017067008 14675 33554432000 4194304 4587354 140736515337248 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 492448 14675 337 96 0 489010 0
[pid=30255] ppid=30253 vsize=97152 CPUtime=1182.21 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 20351 0 0 0 118216 5 0 0 25 0 1 0 248455889 99483648 19728 33554432000 4194304 4785740 140733195786832 18446744073709551615 4287011 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 24288 19728 341 145 0 21333 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=587.95 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 58795 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=22636 CPUtime=1182.31 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 47388 0 0 0 118225 6 0 0 25 0 1 0 248455889 23179264 4842 33554432000 4194304 4352236 140734516837120 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 5659 4842 127 39 0 4739 0
[pid=30258] ppid=30253 vsize=101516 CPUtime=587.91 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 20197 0 0 0 58783 8 0 0 25 0 1 0 248455889 103952384 16871 33554432000 4194304 4331988 140734505465616 18446744073709551615 4299107 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 25379 16871 175 34 0 23821 0
Current children cumulated CPU time (s) 4722.69
Current children cumulated vsize (KiB) 2668024



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 9.26 9.19 8.49 10/187 30291
/proc/meminfo: memFree=21004136/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1969844 CPUtime=1201.72 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 356413 0 0 0 120054 118 0 0 25 0 1 0 248455889 2017120256 12341 33554432000 4194304 4587354 140736515337248 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 492461 12341 337 96 0 489023 0
[pid=30255] ppid=30253 vsize=97340 CPUtime=1201.61 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 20397 0 0 0 120156 5 0 0 25 0 1 0 248455889 99676160 19774 33554432000 4194304 4785740 140733195786832 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 24335 19774 341 145 0 21380 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=597.65 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 59765 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=19436 CPUtime=1201.72 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 47388 0 0 0 120166 6 0 0 25 0 1 0 248455889 19902464 4042 33554432000 4194304 4352236 140734516837120 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 4859 4042 127 39 0 3939 0
[pid=30258] ppid=30253 vsize=101516 CPUtime=597.52 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 20455 0 0 0 59744 8 0 0 25 0 1 0 248455889 103952384 17129 33554432000 4194304 4331988 140734505465616 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 25379 17129 175 34 0 23821 0
Current children cumulated CPU time (s) 4800.22
Current children cumulated vsize (KiB) 2665064

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 9.26 9.19 8.49 10/187 30291
/proc/meminfo: memFree=21004136/32951124 swapFree=67111528/67111528
[pid=30253] ppid=30251 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/30253/stat : 30253 (ppfolio) S 30251 30253 30178 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 248455889 18763776 390 33554432000 4194304 4287625 140736070923408 18446744073709551615 268660682255 0 0 4096 65536 4600734749470752767 0 0 17 4 0 0 0
/proc/30253/statm: 4581 390 341 23 0 91 0
[pid=30254] ppid=30253 vsize=1969844 CPUtime=1201.72 cores=0
/proc/30254/stat : 30254 (cryptominisat) R 30253 30253 30178 0 -1 4202496 356413 0 0 0 120054 118 0 0 25 0 1 0 248455889 2017120256 12341 33554432000 4194304 4587354 140736515337248 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30254/statm: 492461 12341 337 96 0 489023 0
[pid=30255] ppid=30253 vsize=97340 CPUtime=1201.61 cores=4
/proc/30255/stat : 30255 (clasp) R 30253 30253 30178 0 -1 4202496 20397 0 0 0 120156 5 0 0 25 0 1 0 248455889 99676160 19774 33554432000 4194304 4785740 140733195786832 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/30255/statm: 24335 19774 341 145 0 21380 0
[pid=30256] ppid=30253 vsize=458604 CPUtime=597.65 cores=6
/proc/30256/stat : 30256 (TNM) R 30253 30253 30178 0 -1 4202496 1199 0 0 0 59765 0 0 0 25 0 1 0 248455889 469610496 1095 33554432000 134512640 134534564 4289742240 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30256/statm: 114651 1095 95 6 0 113317 0
[pid=30257] ppid=30253 vsize=19436 CPUtime=1201.72 cores=2
/proc/30257/stat : 30257 (lingeling) R 30253 30253 30178 0 -1 4202496 47388 0 0 0 120166 6 0 0 25 0 1 0 248455889 19902464 4042 33554432000 4194304 4352236 140734516837120 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/30257/statm: 4859 4042 127 39 0 3939 0
[pid=30258] ppid=30253 vsize=101516 CPUtime=597.52 cores=6
/proc/30258/stat : 30258 (march_hi) R 30253 30253 30178 0 -1 4202496 20455 0 0 0 59744 8 0 0 25 0 1 0 248455889 103952384 17129 33554432000 4194304 4331988 140734505465616 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/30258/statm: 25379 17129 175 34 0 23821 0
Current children cumulated CPU time (s) 4800.22
Current children cumulated vsize (KiB) 2665064

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30253 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.001999
# while last known CPU time is 4800.22
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.22
CPU user time (s): 4798.85
CPU system time (s): 1.37
CPU usage (%): 399.448
Max. virtual memory (cumulated for all children) (KiB): 9842568

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 524
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 368
involuntary context switches= 6

runsolver used 2.06369 second user time and 4.49932 second system time

The end

Launcher Data 

Begin job on node107 at 2011-04-29 04:04:06
IDJOB=3190895
IDBENCH=82626
IDSOLVER=1612
FILE ID=node107/3190895-1304042646
RUNJOBID= node107-1304042629-30196
PBS_JOBID= 13170385
Free space on /tmp= 71792 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S894356234-063-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3190895-1304042646/watcher-3190895-1304042646 -o /tmp/evaluation-result-3190895-1304042646/solver-3190895-1304042646 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3190895-1304042646.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c26a52ff3714cab8bc335a81bb8af922
RANDOM SEED=1696721887

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21328756 kB
Buffers:       2018408 kB
Cached:        8985724 kB
SwapCached:          0 kB
Active:        3087616 kB
Inactive:      8053772 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21328756 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           21564 kB
Writeback:           8 kB
AnonPages:      137132 kB
Mapped:          16740 kB
Slab:           416180 kB
PageTables:       5076 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2219544 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71780 MiB
End job on node107 at 2011-04-29 04:24:10