Trace number 3285350

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.15 1201.91

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf
MD5SUM6ed645315c9ffb8177453b955fbe1737
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1200.86
Satisfiable
(Un)Satisfiability was proved
Number of variables109684
Number of clauses1767096
Sum of the clauses size4034296
Maximum clause length78
Minimum clause length1
Number of clauses of size 1696
Number of clauses of size 21705200
Number of clauses of size 34800
Number of clauses of size 422200
Number of clauses of size 59600
Number of clauses of size over 524600

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3285350-1304035159/watcher-3285350-1304035159 -o /tmp/evaluation-result-3285350-1304035159/solver-3285350-1304035159 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3285350-1304035159.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.94 10.12 9.82 6/182 32017
/proc/meminfo: memFree=19461604/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) R 32015 32017 31281 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0

[startup+0.142237 s]
/proc/loadavg: 9.94 10.12 9.82 6/182 32017
/proc/meminfo: memFree=19461604/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200226 s]
/proc/loadavg: 9.94 10.12 9.82 6/182 32017
/proc/meminfo: memFree=19461604/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.30021 s]
/proc/loadavg: 9.94 10.12 9.82 6/182 32017
/proc/meminfo: memFree=19461604/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700139 s]
/proc/loadavg: 9.94 10.12 9.82 6/182 32017
/proc/meminfo: memFree=19461604/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 21 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.501 s]
/proc/loadavg: 9.94 10.12 9.82 11/188 32023
/proc/meminfo: memFree=19120800/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 21 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=133700 CPUtime=1.49 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 27201 0 0 0 145 4 0 0 25 0 1 0 515115747 136908800 26955 33554432000 4194304 4587354 140735911200384 18446744073709551615 4230266 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 33425 26955 306 96 0 29987 0
[pid=32019] ppid=32017 vsize=119580 CPUtime=1.49 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 33804 0 0 0 145 4 0 0 25 0 1 0 515115747 122449920 26474 33554432000 4194304 4785740 140733749419024 18446744073709551615 4416801 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 29895 26474 320 145 0 26940 0
[pid=32020] ppid=32017 vsize=470084 CPUtime=0.74 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 7988 0 0 0 73 1 0 0 25 0 1 0 515115747 481366016 7885 33554432000 134512640 134534564 4291661632 18446744073709551615 3214067 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 117521 7885 90 6 0 116187 0
[pid=32021] ppid=32017 vsize=46508 CPUtime=1.49 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 11745 0 0 0 147 2 0 0 25 0 1 0 515115747 47624192 10804 33554432000 4194304 4352236 140736147944560 18446744073709551615 4234513 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 11627 10804 110 39 0 10707 0
[pid=32022] ppid=32017 vsize=85224 CPUtime=0.73 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4194304 19533 0 0 0 69 4 0 0 25 0 1 0 515115747 87269376 19427 33554432000 4194304 4331988 140734419937536 18446744073709551615 237278517390 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 21306 19427 113 34 0 19748 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 873420

[startup+3.10071 s]
/proc/loadavg: 9.94 10.12 9.82 11/188 32023
/proc/meminfo: memFree=19034124/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=161840 CPUtime=3.08 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 34217 0 0 0 304 4 0 0 25 0 1 0 515115747 165724160 33971 33554432000 4194304 4587354 140735911200384 18446744073709551615 4367369 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 40460 33971 312 96 0 37022 0
[pid=32019] ppid=32017 vsize=107896 CPUtime=3.08 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 34018 0 0 0 304 4 0 0 25 0 1 0 515115747 110485504 23966 33554432000 4194304 4785740 140733749419024 18446744073709551615 4553083 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 26974 23966 340 145 0 24019 0
[pid=32020] ppid=32017 vsize=544660 CPUtime=1.54 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 30885 0 0 0 150 4 0 0 25 0 1 0 515115747 557731840 30781 33554432000 134512640 134534564 4291661632 18446744073709551615 134524672 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 136165 30781 91 6 0 134831 0
[pid=32021] ppid=32017 vsize=49688 CPUtime=3.09 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 21086 0 0 0 306 3 0 0 25 0 1 0 515115747 50880512 11577 33554432000 4194304 4352236 140736147944560 18446744073709551615 4283760 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 12422 11577 121 39 0 11502 0
[pid=32022] ppid=32017 vsize=185992 CPUtime=1.52 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4194304 38779 0 0 0 146 6 0 0 25 0 1 0 515115747 190455808 27800 33554432000 4194304 4331988 140734419937536 18446744073709551615 237278535009 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 46498 27800 128 34 0 44940 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 1068400

[startup+6.30115 s]
/proc/loadavg: 10.02 10.14 9.83 11/188 32023
/proc/meminfo: memFree=18900584/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=201616 CPUtime=6.29 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 56243 0 0 0 621 8 0 0 25 0 1 0 515115747 206454784 41818 33554432000 4194304 4587354 140735911200384 18446744073709551615 4236422 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 50404 41818 330 96 0 46966 0
[pid=32019] ppid=32017 vsize=107896 CPUtime=6.29 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 34018 0 0 0 625 4 0 0 25 0 1 0 515115747 110485504 23966 33554432000 4194304 4785740 140733749419024 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 26974 23966 340 145 0 24019 0
[pid=32020] ppid=32017 vsize=544660 CPUtime=3.14 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 30885 0 0 0 310 4 0 0 25 0 1 0 515115747 557731840 30781 33554432000 134512640 134534564 4291661632 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 136165 30781 91 6 0 134831 0
[pid=32021] ppid=32017 vsize=49688 CPUtime=6.28 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 21098 0 0 0 624 4 0 0 25 0 1 0 515115747 50880512 11589 33554432000 4194304 4352236 140736147944560 18446744073709551615 4270802 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 12422 11589 127 39 0 11502 0
[pid=32022] ppid=32017 vsize=185976 CPUtime=3.1 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 38804 0 0 0 304 6 0 0 25 0 1 0 515115747 190439424 27821 33554432000 4194304 4331988 140734419937536 18446744073709551615 237278534649 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 46494 27821 148 34 0 44936 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 1108160

[startup+12.701 s]
/proc/loadavg: 10.02 10.13 9.83 11/188 32024
/proc/meminfo: memFree=18800904/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=239120 CPUtime=12.68 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 58793 0 0 0 1260 8 0 0 25 0 1 0 515115747 244858880 44361 33554432000 4194304 4587354 140735911200384 18446744073709551615 4236402 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 59780 44361 330 96 0 56342 0
[pid=32019] ppid=32017 vsize=107896 CPUtime=12.69 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 34018 0 0 0 1265 4 0 0 25 0 1 0 515115747 110485504 23966 33554432000 4194304 4785740 140733749419024 18446744073709551615 4549853 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 26974 23966 340 145 0 24019 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=6.3 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 625 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=50996 CPUtime=12.68 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 21428 0 0 0 1264 4 0 0 25 0 1 0 515115747 52219904 11917 33554432000 4194304 4352236 140736147944560 18446744073709551615 4281230 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 12749 11917 127 39 0 11829 0
[pid=32022] ppid=32017 vsize=334440 CPUtime=6.3 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 66747 0 0 0 621 9 0 0 25 0 1 0 515115747 342466560 35402 33554432000 4194304 4331988 140734419937536 18446744073709551615 4295721 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 83610 35402 160 34 0 82052 0
Current children cumulated CPU time (s) 50.65
Current children cumulated vsize (KiB) 1328964

[startup+25.5007 s]
/proc/loadavg: 10.10 10.14 9.83 11/188 32024
/proc/meminfo: memFree=18744240/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=239120 CPUtime=25.49 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 64454 0 0 0 2539 10 0 0 25 0 1 0 515115747 244858880 50016 33554432000 4194304 4587354 140735911200384 18446744073709551615 4236558 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 59780 50016 330 96 0 56342 0
[pid=32019] ppid=32017 vsize=107896 CPUtime=25.49 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 34018 0 0 0 2545 4 0 0 25 0 1 0 515115747 110485504 23966 33554432000 4194304 4785740 140733749419024 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 26974 23966 340 145 0 24019 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=12.63 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 1258 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=55176 CPUtime=25.48 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 22474 0 0 0 2544 4 0 0 25 0 1 0 515115747 56500224 12962 33554432000 4194304 4352236 140736147944560 18446744073709551615 4278742 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 13794 12962 127 39 0 12874 0
[pid=32022] ppid=32017 vsize=350180 CPUtime=12.7 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 71133 0 0 0 1260 10 0 0 25 0 1 0 515115747 358584320 39788 33554432000 4194304 4331988 140734419937536 18446744073709551615 4210412 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 87545 39788 172 34 0 85987 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 1348884

[startup+51.1012 s]
/proc/loadavg: 10.06 10.13 9.84 11/188 32025
/proc/meminfo: memFree=18710716/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=302480 CPUtime=51.09 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 78105 0 0 0 5093 16 0 0 25 0 1 0 515115747 309739520 46712 33554432000 4194304 4587354 140735911200384 18446744073709551615 4236479 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 75620 46712 330 96 0 72182 0
[pid=32019] ppid=32017 vsize=121156 CPUtime=51.09 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 37563 0 0 0 5104 5 0 0 25 0 1 0 515115747 124063744 27511 33554432000 4194304 4785740 140733749419024 18446744073709551615 4290633 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 30289 27511 340 145 0 27334 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=25.4 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 2535 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=97544 CPUtime=51.08 cores=2

################
# More data... #
################

/proc/32022/statm: 106013 57809 175 34 0 104455 0
Current children cumulated CPU time (s) 3523.49
Current children cumulated vsize (KiB) 4493820

[startup+942.301 s]
/proc/loadavg: 10.23 10.18 10.03 12/188 32093
/proc/meminfo: memFree=16900236/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=2359644 CPUtime=942.28 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 672704 0 0 0 94066 162 0 0 25 0 1 0 515115747 2416275456 133017 33554432000 4194304 4587354 140735911200384 18446744073709551615 4236595 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 589911 133017 338 96 0 586473 0
[pid=32019] ppid=32017 vsize=937292 CPUtime=941.66 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 241439 0 0 0 94106 60 0 0 25 0 1 0 515115747 959787008 231387 33554432000 4194304 4785740 140733749419024 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 234323 231387 340 145 0 231368 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=468.56 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 46851 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=214784 CPUtime=942.04 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 267726 0 0 0 94171 33 0 0 25 0 1 0 515115747 219938816 52864 33554432000 4194304 4352236 140736147944560 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 53696 52864 127 39 0 52776 0
[pid=32022] ppid=32017 vsize=424052 CPUtime=468.59 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 89237 0 0 0 46846 13 0 0 25 0 1 0 515115747 434229248 57831 33554432000 4194304 4331988 140734419937536 18446744073709551615 4237391 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 106013 57831 175 34 0 104455 0
Current children cumulated CPU time (s) 3763.13
Current children cumulated vsize (KiB) 4532284

[startup+1002.3 s]
/proc/loadavg: 10.13 10.16 10.03 12/188 32095
/proc/meminfo: memFree=16847644/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=2378360 CPUtime=1002.28 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 690495 0 0 0 100060 168 0 0 25 0 1 0 515115747 2435440640 129596 33554432000 4194304 4587354 140735911200384 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 594590 129596 338 96 0 591152 0
[pid=32019] ppid=32017 vsize=991004 CPUtime=1001.66 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 254895 0 0 0 100103 63 0 0 25 0 1 0 515115747 1014788096 244843 33554432000 4194304 4785740 140733749419024 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 247751 244843 340 145 0 244796 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=498.4 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 49835 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=222976 CPUtime=1002.04 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 269774 0 0 0 100170 34 0 0 25 0 1 0 515115747 228327424 54912 33554432000 4194304 4352236 140736147944560 18446744073709551615 4231009 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 55744 54912 127 39 0 54824 0
[pid=32022] ppid=32017 vsize=424316 CPUtime=498.42 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 89322 0 0 0 49829 13 0 0 25 0 1 0 515115747 434499584 57916 33554432000 4194304 4331988 140734419937536 18446744073709551615 237278275285 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 106079 57916 175 34 0 104521 0
Current children cumulated CPU time (s) 4002.8
Current children cumulated vsize (KiB) 4613168

[startup+1062.3 s]
/proc/loadavg: 10.14 10.16 10.03 12/188 32097
/proc/meminfo: memFree=16792572/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=2374432 CPUtime=1062.28 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 708097 0 0 0 106053 175 0 0 25 0 1 0 515115747 2431418368 123532 33554432000 4194304 4587354 140735911200384 18446744073709551615 4236491 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 593608 123532 338 96 0 590170 0
[pid=32019] ppid=32017 vsize=1023704 CPUtime=1061.67 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 263067 0 0 0 106102 65 0 0 25 0 1 0 515115747 1048272896 253015 33554432000 4194304 4785740 140733749419024 18446744073709551615 4536814 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 255926 253015 340 145 0 252971 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=528.25 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 52820 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=222932 CPUtime=1062.04 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 269774 0 0 0 106170 34 0 0 25 0 1 0 515115747 228282368 54901 33554432000 4194304 4352236 140736147944560 18446744073709551615 4327902 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 55733 54901 127 39 0 54813 0
[pid=32022] ppid=32017 vsize=426624 CPUtime=528.25 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 89907 0 0 0 52812 13 0 0 25 0 1 0 515115747 436862976 58501 33554432000 4194304 4331988 140734419937536 18446744073709551615 4226620 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 106656 58501 175 34 0 105098 0
Current children cumulated CPU time (s) 4242.49
Current children cumulated vsize (KiB) 4644204

[startup+1122.3 s]
/proc/loadavg: 10.09 10.14 10.03 12/188 32098
/proc/meminfo: memFree=16739856/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=2383200 CPUtime=1122.28 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 726624 0 0 0 112046 182 0 0 25 0 1 0 515115747 2440396800 121499 33554432000 4194304 4587354 140735911200384 18446744073709551615 4236816 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 595800 121499 338 96 0 592362 0
[pid=32019] ppid=32017 vsize=1069224 CPUtime=1121.66 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 274443 0 0 0 112099 67 0 0 25 0 1 0 515115747 1094885376 264391 33554432000 4194304 4785740 140733749419024 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 267306 264391 340 145 0 264351 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=558.06 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 55801 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=235220 CPUtime=1122.03 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 305615 0 0 0 112165 38 0 0 25 0 1 0 515115747 240865280 57973 33554432000 4194304 4352236 140736147944560 18446744073709551615 4207908 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 58805 57973 127 39 0 57885 0
[pid=32022] ppid=32017 vsize=426760 CPUtime=558.12 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 89951 0 0 0 55798 14 0 0 25 0 1 0 515115747 437002240 58545 33554432000 4194304 4331988 140734419937536 18446744073709551615 4239523 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 106690 58545 175 34 0 105132 0
Current children cumulated CPU time (s) 4482.15
Current children cumulated vsize (KiB) 4710916

[startup+1182.3 s]
/proc/loadavg: 10.16 10.16 10.04 12/188 32100
/proc/meminfo: memFree=16606172/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=2383200 CPUtime=1182.29 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 744140 0 0 0 118040 189 0 0 25 0 1 0 515115747 2440396800 138994 33554432000 4194304 4587354 140735911200384 18446744073709551615 4449056 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 595800 138994 338 96 0 592362 0
[pid=32019] ppid=32017 vsize=1121328 CPUtime=1181.67 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 287164 0 0 0 118097 70 0 0 25 0 1 0 515115747 1148239872 277112 33554432000 4194304 4785740 140733749419024 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 280332 277112 340 145 0 277377 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=587.94 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 58789 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=235220 CPUtime=1182.03 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 305615 0 0 0 118165 38 0 0 25 0 1 0 515115747 240865280 57973 33554432000 4194304 4352236 140736147944560 18446744073709551615 4207645 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 58805 57973 127 39 0 57885 0
[pid=32022] ppid=32017 vsize=431152 CPUtime=587.92 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 90762 0 0 0 58778 14 0 0 25 0 1 0 515115747 441499648 59356 33554432000 4194304 4331988 140734419937536 18446744073709551615 4237136 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 107788 59356 220 34 0 106230 0
Current children cumulated CPU time (s) 4721.85
Current children cumulated vsize (KiB) 4767412



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 10.26 10.18 10.05 11/188 32100
/proc/meminfo: memFree=16465428/32950904 swapFree=67082284/67111528
[pid=32017] ppid=32015 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/32017/stat : 32017 (ppfolio) S 32015 32017 31281 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 515115746 18763776 390 33554432000 4194304 4287625 140737273283872 18446744073709551615 237278899727 0 0 4096 65536 3167041955595026431 0 0 17 4 0 0 0
/proc/32017/statm: 4581 390 341 23 0 91 0
[pid=32018] ppid=32017 vsize=2501648 CPUtime=1201.89 cores=0
/proc/32018/stat : 32018 (cryptominisat) R 32017 32017 31281 0 -1 4202496 774070 0 0 0 119996 193 0 0 25 0 1 0 515115747 2561687552 168924 33554432000 4194304 4587354 140735911200384 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32018/statm: 625412 168924 338 96 0 621974 0
[pid=32019] ppid=32017 vsize=1136864 CPUtime=1201.28 cores=4
/proc/32019/stat : 32019 (clasp) R 32017 32017 31281 0 -1 4202496 291075 0 0 0 120058 70 0 0 25 0 1 0 515115747 1164148736 281023 33554432000 4194304 4785740 140733749419024 18446744073709551615 4290576 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/32019/statm: 284216 281023 340 145 0 281261 0
[pid=32020] ppid=32017 vsize=578188 CPUtime=597.64 cores=6
/proc/32020/stat : 32020 (TNM) R 32017 32017 31281 0 -1 4202496 47584 0 0 0 59759 5 0 0 25 0 1 0 515115747 592064512 47480 33554432000 134512640 134534564 4291661632 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32020/statm: 144547 47480 95 6 0 143213 0
[pid=32021] ppid=32017 vsize=235220 CPUtime=1201.63 cores=2
/proc/32021/stat : 32021 (lingeling) R 32017 32017 31281 0 -1 4202496 305615 0 0 0 120125 38 0 0 25 0 1 0 515115747 240865280 57973 33554432000 4194304 4352236 140736147944560 18446744073709551615 4328051 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/32021/statm: 58805 57973 127 39 0 57885 0
[pid=32022] ppid=32017 vsize=431152 CPUtime=597.71 cores=6
/proc/32022/stat : 32022 (march_hi) R 32017 32017 31281 0 -1 4202496 90764 0 0 0 59757 14 0 0 25 0 1 0 515115747 441499648 59358 33554432000 4194304 4331988 140734419937536 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/32022/statm: 107788 59358 220 34 0 106230 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 4901396

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32017 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=2999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.006998
# while last known CPU time is 4800.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.91
CPU time (s): 4800.15
CPU user time (s): 4796.95
CPU system time (s): 3.2
CPU usage (%): 399.376
Max. virtual memory (cumulated for all children) (KiB): 6559780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.002999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 524
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 214
involuntary context switches= 7

runsolver used 1.91571 second user time and 4.64829 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 01:59:20
IDJOB=3285350
IDBENCH=82379
IDSOLVER=1612
FILE ID=node121/3285350-1304035159
RUNJOBID= node121-1304032644-31666
PBS_JOBID= 13170331
Free space on /tmp= 72612 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/rintanen/SATPlanning/sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3285350-1304035159/watcher-3285350-1304035159 -o /tmp/evaluation-result-3285350-1304035159/solver-3285350-1304035159 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3285350-1304035159.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6ed645315c9ffb8177453b955fbe1737
RANDOM SEED=781051124

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      19461768 kB
Buffers:       2177924 kB
Cached:       10231968 kB
SwapCached:       2776 kB
Active:        9652384 kB
Inactive:      3313864 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      19461768 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           40232 kB
Writeback:           0 kB
AnonPages:      553844 kB
Mapped:          15808 kB
Slab:           456000 kB
PageTables:       6284 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:  3202992 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72596 MiB
End job on node121 at 2011-04-29 02:19:24