Trace number 3483913

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed, 1200 s timeout)? (TO) 1200.08 1222.58

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
blocks-blocks-36-0.120-NOTKNOWN.cnf
MD5SUM8d94c04f870c828c80bd9a45ae3dedff
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark603.823
Satisfiable
(Un)Satisfiability was proved
Number of variables489685
Number of clauses8779920
Sum of the clauses size19139520
Maximum clause length1334
Minimum clause length1
Number of clauses of size 11440
Number of clauses of size 28441280
Number of clauses of size 3319680
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517520

Solver Data 

0.45/22.58	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.45/22.58	c INFO: solving HOME/instance-3483913-1307894553.cnf
0.45/22.58	c INFO: computing task features
31.34/53.63	c INFO: computed variable-clause graph statistics
32.33/54.60	c INFO: computed clause balance statistics
134.13/156.46	c INFO: computed variable balance statistics
222.63/244.92	c INFO: computed small-clause counts
227.33/249.67	c INFO: computed Horn-clause counts
511.32/533.60	c INFO: computed variable graph statistics
511.32/533.63	c INFO: collected features for HOME/instance-3483913-1307894553.cnf in 509.17 s
511.32/533.64	c INFO: running lingeling-276@0 for 97 with 690 remaining (b = 0.78)
611.51/633.81	c INFO: running lingeling-276@99 for 194 with 590 remaining (b = 0.54)
808.67/831.05	c INFO: running lingeling-276@0 for 97 with 394 remaining (b = 0.70)
908.82/931.22	c INFO: running lingeling-276@296 for 97 with 294 remaining (b = 0.56)
1005.88/1028.34	c INFO: running lingeling-276@393 for 97 with 197 remaining (b = 0.60)
1101.00/1123.46	c INFO: running precosat-570@0 for 102 with 102 remaining (b = 0.59)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3483913-1307894553/watcher-3483913-1307894553 -o /tmp/evaluation-result-3483913-1307894553/solver-3483913-1307894553 -C 1200 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3483913-1307894553.cnf -seed 1379018934 -budget 1200 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.68 1.40 1.71 3/190 17988
/proc/meminfo: memFree=1241620/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=15380 CPUtime=0 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 793 0 0 0 0 0 0 0 21 0 1 0 979686512 15749120 679 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/17988/statm: 3845 679 322 364 0 332 0

[startup+0.00842407 s]
/proc/loadavg: 0.68 1.40 1.71 3/190 17988
/proc/meminfo: memFree=1241620/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=15760 CPUtime=0 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 844 0 0 0 0 0 0 0 21 0 1 0 979686512 16138240 726 33554432000 4194304 5683644 140733373163104 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/17988/statm: 3941 727 334 364 0 428 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15760

[startup+0.100453 s]
/proc/loadavg: 0.68 1.40 1.71 3/190 17988
/proc/meminfo: memFree=1241620/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=16244 CPUtime=0.01 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 1052 0 0 0 1 0 0 0 21 0 1 0 979686512 16633856 922 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/17988/statm: 4061 922 381 364 0 548 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16244

[startup+0.300416 s]
/proc/loadavg: 0.68 1.40 1.71 3/190 17988
/proc/meminfo: memFree=1241620/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=18888 CPUtime=0.01 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 1252 0 0 0 1 0 0 0 19 0 1 0 979686512 19341312 1105 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/17988/statm: 4722 1105 421 364 0 691 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18888

[startup+0.700378 s]
/proc/loadavg: 0.68 1.40 1.71 3/190 17988
/proc/meminfo: memFree=1241620/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=54540 CPUtime=0.05 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 2058 0 0 0 4 1 0 0 15 0 1 0 979686512 55848960 1814 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/17988/statm: 13635 1814 492 364 0 1285 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 54540

[startup+1.50022 s]
/proc/loadavg: 0.68 1.40 1.71 2/191 17989
/proc/meminfo: memFree=1192648/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=124240 CPUtime=0.13 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 4313 0 1 0 9 4 0 0 15 0 1 0 979686512 127221760 3880 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284925696 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/17988/statm: 31060 3880 997 364 0 2871 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 124240

[startup+3.10095 s]
/proc/loadavg: 1.18 1.50 1.74 2/193 17991
/proc/meminfo: memFree=1144204/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=124240 CPUtime=0.13 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 4313 0 1 0 9 4 0 0 15 0 1 0 979686512 127221760 3880 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284925696 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/17988/statm: 31060 3880 997 364 0 2871 0
[pid=17990] ppid=17988 vsize=8700 CPUtime=0 cores=5,7
/proc/17990/stat : 17990 (sh) S 17988 17988 17918 0 -1 4202496 307 0 0 0 0 0 0 0 15 0 1 0 979686628 8908800 246 33554432000 4194304 4922060 140735622103616 18446744073709551615 224284744837 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/17990/statm: 2175 246 206 178 0 68 0
[pid=17991] ppid=17990 vsize=788 CPUtime=0 cores=5,7
/proc/17991/stat : 17991 (ldconfig) D 17990 17988 17918 0 -1 4194304 65 0 0 0 0 0 0 0 18 0 1 0 979686628 806912 1 33554432000 0 0 140736363521993 18446744073709551615 224284746743 0 0 16781312 0 18446744071562234166 0 0 17 5 0 0 79
/proc/17991/statm: 197 1 0 0 0 24 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 133728
heavy processes:

[startup+6.30038 s]
/proc/loadavg: 1.18 1.50 1.74 1/191 17991
/proc/meminfo: memFree=1130160/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=124240 CPUtime=0.13 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 4313 0 1 0 9 4 0 0 15 0 1 0 979686512 127221760 3880 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284925696 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/17988/statm: 31060 3880 997 364 0 2871 0
[pid=17990] ppid=17988 vsize=8700 CPUtime=0 cores=5,7
/proc/17990/stat : 17990 (sh) S 17988 17988 17918 0 -1 4202496 307 0 0 0 0 0 0 0 15 0 1 0 979686628 8908800 246 33554432000 4194304 4922060 140735622103616 18446744073709551615 224284744837 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/17990/statm: 2175 246 206 178 0 68 0
[pid=17991] ppid=17990 vsize=788 CPUtime=0 cores=5,7
/proc/17991/stat : 17991 (ldconfig) D 17990 17988 17918 0 -1 4194304 69 0 2 0 0 0 0 0 18 0 1 0 979686628 806912 7 33554432000 4194304 4893030 140736363514208 18446744073709551615 4371008 0 0 16781312 0 18446744071562234166 0 0 17 5 0 0 397
/proc/17991/statm: 197 7 2 171 0 24 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 133728
heavy processes:

[startup+12.7004 s]
/proc/loadavg: 2.08 1.68 1.80 1/198 18003
/proc/meminfo: memFree=1081668/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=124240 CPUtime=0.13 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 4313 0 1 0 9 4 0 0 15 0 1 0 979686512 127221760 3880 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284925696 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/17988/statm: 31060 3880 997 364 0 2871 0
[pid=17990] ppid=17988 vsize=8700 CPUtime=0 cores=5,7
/proc/17990/stat : 17990 (sh) S 17988 17988 17918 0 -1 4202496 307 0 0 0 0 0 0 0 15 0 1 0 979686628 8908800 246 33554432000 4194304 4922060 140735622103616 18446744073709551615 224284744837 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/17990/statm: 2175 246 206 178 0 68 0
[pid=17991] ppid=17990 vsize=924 CPUtime=0 cores=5,7
/proc/17991/stat : 17991 (ldconfig) D 17990 17988 17918 0 -1 4202496 91 0 6 0 0 0 0 0 18 0 1 0 979686628 946176 32 33554432000 4194304 4893030 140736363514208 18446744073709551615 4634864 0 0 16781312 0 18446744071562234166 0 0 17 5 0 0 1063
/proc/17991/statm: 231 32 23 171 0 58 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 133864
heavy processes:

[startup+25.5002 s]
/proc/loadavg: 2.60 1.80 1.84 7/190 18011
/proc/meminfo: memFree=92260/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=638368 CPUtime=3.37 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 97457 924 39 10 306 31 0 0 19 0 1 0 979686512 653688832 95163 33554432000 4194304 5683644 140733373163104 18446744073709551615 4421962 0 0 16781312 2 0 0 0 17 7 0 0 509
/proc/17988/statm: 159592 95163 1761 364 0 95516 0
Current children cumulated CPU time (s) 3.37
Current children cumulated vsize (KiB) 638368
heavy processes:

[startup+51.1009 s]
/proc/loadavg: 3.08 1.98 1.89 5/190 18013
/proc/meminfo: memFree=252500/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1638556 CPUtime=28.84 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 968948 924 39 10 2744 140 0 0 25 0 1 0 979686512 1677881344 347012 33554432000 4194304 5683644 140733373163104 18446744073709551615 47299452507745 0 0 16781312 2 0 0 0 17 5 0 0 509
/proc/17988/statm: 409639 347012 1815 364 0 345563 0
Current children cumulated CPU time (s) 28.84
Current children cumulated vsize (KiB) 1638556
heavy processes:

[startup+102.306 s]
/proc/loadavg: 3.63 2.32 2.01 5/190 18013
/proc/meminfo: memFree=582904/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1569960 CPUtime=80.03 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 1020407 924 39 10 7857 146 0 0 25 0 1 0 979686512 1607639040 329874 33554432000 4194304 5683644 140733373163104 18446744073709551615 47299452174145 0 0 16781312 2 0 0 0 17 5 0 0 509
/proc/17988/statm: 392490 329874 1826 364 0 328414 0
Current children cumulated CPU time (s) 80.03
Current children cumulated vsize (KiB) 1569960
heavy processes:

[startup+162.3 s]
/proc/loadavg: 3.92 2.64 2.14 5/196 18021
/proc/meminfo: memFree=591280/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1569960 CPUtime=140.03 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 1020408 924 39 10 13857 146 0 0 25 0 1 0 979686512 1607639040 329875 33554432000 4194304 5683644 140733373163104 18446744073709551615 224288334505 0 0 16781312 2 0 0 0 17 5 0 0 509
/proc/17988/statm: 392490 329875 1827 364 0 328414 0
Current children cumulated CPU time (s) 140.03
Current children cumulated vsize (KiB) 1569960

[startup+222.3 s]
/proc/loadavg: 3.97 2.88 2.25 5/196 18023
/proc/meminfo: memFree=509548/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1569960 CPUtime=200.03 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 1020408 924 39 10 19857 146 0 0 25 0 1 0 979686512 1607639040 329875 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284580902 0 0 16781312 2 0 0 0 17 5 0 0 509
/proc/17988/statm: 392490 329875 1827 364 0 328414 0
Current children cumulated CPU time (s) 200.03
Current children cumulated vsize (KiB) 1569960

[startup+282.3 s]
/proc/loadavg: 3.99 3.07 2.35 6/196 18025
/proc/meminfo: memFree=510072/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1569960 CPUtime=260.03 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 1380543 924 39 10 25817 186 0 0 25 0 1 0 979686512 1607639040 329881 33554432000 4194304 5683644 140733373163104 18446744073709551615 47299452094592 0 0 16781312 2 0 0 0 17 5 0 0 509
/proc/17988/statm: 392490 329881 1833 364 0 328414 0
Current children cumulated CPU time (s) 260.03
Current children cumulated vsize (KiB) 1569960

[startup+342.3 s]
/proc/loadavg: 4.02 3.26 2.46 5/200 18031
/proc/meminfo: memFree=411852/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1569960 CPUtime=320.03 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 1380543 924 39 10 31817 186 0 0 25 0 1 0 979686512 1607639040 329881 33554432000 4194304 5683644 140733373163104 18446744073709551615 47299452094604 0 0 16781312 2 0 0 0 17 5 0 0 509
/proc/17988/statm: 392490 329881 1833 364 0 328414 0
Current children cumulated CPU time (s) 320.03
Current children cumulated vsize (KiB) 1569960

[startup+402.3 s]
/proc/loadavg: 4.01 3.38 2.55 5/200 18031
/proc/meminfo: memFree=197628/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1569960 CPUtime=380.02 cores=5,7
/proc/17988/stat : 17988 (python) R 17986 17988 17918 0 -1 4202496 1380543 924 39 10 37816 186 0 0 25 0 1 0 979686512 1607639040 329881 33554432000 4194304 5683644 140733373163104 18446744073709551615 47299452094604 0 0 16781312 2 0 0 0 17 5 0 0 509
/proc/17988/statm: 392490 329881 1833 364 0 328414 0
Current children cumulated CPU time (s) 380.02
Current children cumulated vsize (KiB) 1569960

[startup+462.3 s]
/proc/loadavg: 4.03 3.51 2.65 5/201 18034
/proc/meminfo: memFree=506444/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1569960 CPUtime=440.02 cores=5,7

################
# More data... #
################

/proc/18060/task/18065/stat : 18065 (python) S 17988 17988 17918 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 979779634 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604454223472448 0 0 -1 5 0 0 0
[pid=17988/tid=18045] ppid=17986 vsize=1014144 CPUtime=0 cores=5,7
/proc/17988/task/18045/stat : 18045 (python) S 17986 17988 17918 0 -1 4202560 36 924 0 10 0 0 0 0 18 0 3 0 979739878 1038483456 185841 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
[pid=17988/tid=18061] ppid=17986 vsize=1014144 CPUtime=0 cores=5,7
/proc/17988/task/18061/stat : 18061 (python) S 17986 17988 17918 0 -1 4202560 23 924 0 10 0 0 0 0 20 0 3 0 979769619 1038483456 185841 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1039.9
Current children cumulated vsize (KiB) 3415772

[startup+1122.3 s]
/proc/loadavg: 4.02 3.96 3.33 5/223 18074
/proc/meminfo: memFree=723176/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1014144 CPUtime=511.41 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 1382227 924 39 10 50949 192 0 0 18 0 3 0 979686512 1038483456 185841 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 509
/proc/17988/statm: 253536 185841 1870 364 0 189451 0
[pid=18044] ppid=17988 vsize=1003888 CPUtime=0.66 cores=5,7
/proc/18044/stat : 18044 (python) S 17988 17988 17918 0 -1 4202560 1203 0 0 0 35 31 0 0 18 0 2 0 979739876 1027981312 184383 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284945990 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18044/statm: 250972 184383 415 364 0 186890 0
[pid=18046] ppid=18044 vsize=212084 CPUtime=487.74 cores=5,7
/proc/18046/stat : 18046 (lingeling) R 18044 18046 18046 0 -1 4202496 155250 0 0 0 48750 24 0 0 25 0 1 0 979739878 217174016 52191 33554432000 4194304 4352236 140733848873664 18446744073709551615 4280978 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/18046/statm: 53021 52191 129 39 0 52101 0
[pid=18044/tid=18052] ppid=17988 vsize=1003888 CPUtime=0 cores=5,7
/proc/18044/task/18052/stat : 18052 (python) S 17988 17988 17918 0 -1 4202560 124 0 0 0 0 0 0 0 18 0 2 0 979749893 1027981312 184383 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604471130088384 0 0 -1 7 0 0 0
[pid=18060] ppid=17988 vsize=1003900 CPUtime=0.14 cores=5,7
/proc/18060/stat : 18060 (python) S 17988 17988 17918 0 -1 4202560 1083 0 0 0 6 8 0 0 19 0 2 0 979769617 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18060/statm: 250975 184367 399 364 0 186890 0
[pid=18062] ppid=18060 vsize=181712 CPUtime=99.95 cores=5,7
/proc/18062/stat : 18062 (lingeling) T 18060 18062 18062 0 -1 4202496 73253 0 0 0 9982 13 0 0 25 0 1 0 979769619 186073088 44598 33554432000 4194304 4352236 140734165502448 18446744073709551615 4280965 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/18062/statm: 45428 44598 129 39 0 44508 0
[pid=18060/tid=18065] ppid=17988 vsize=1003900 CPUtime=0 cores=5,7
/proc/18060/task/18065/stat : 18065 (python) S 17988 17988 17918 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 979779634 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604454223472448 0 0 -1 5 0 0 0
[pid=17988/tid=18045] ppid=17986 vsize=1014144 CPUtime=0 cores=5,7
/proc/17988/task/18045/stat : 18045 (python) S 17986 17988 17918 0 -1 4202560 36 924 0 10 0 0 0 0 18 0 3 0 979739878 1038483456 185841 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
[pid=17988/tid=18061] ppid=17986 vsize=1014144 CPUtime=0 cores=5,7
/proc/17988/task/18061/stat : 18061 (python) S 17986 17988 17918 0 -1 4202560 23 924 0 10 0 0 0 0 20 0 3 0 979769619 1038483456 185841 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1099.9
Current children cumulated vsize (KiB) 3415728

[startup+1182.3 s]
/proc/loadavg: 4.01 3.96 3.36 5/226 18079
/proc/meminfo: memFree=234880/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1024400 CPUtime=511.43 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 1382521 924 39 10 50949 194 0 0 20 0 4 0 979686512 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 509
/proc/17988/statm: 256100 185847 1872 364 0 192012 0
[pid=18044] ppid=17988 vsize=1003888 CPUtime=0.68 cores=5,7
/proc/18044/stat : 18044 (python) S 17988 17988 17918 0 -1 4202560 1203 0 0 0 36 32 0 0 18 0 2 0 979739876 1027981312 184383 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18044/statm: 250972 184383 415 364 0 186890 0
[pid=18046] ppid=18044 vsize=212084 CPUtime=488.9 cores=5,7
/proc/18046/stat : 18046 (lingeling) T 18044 18046 18046 0 -1 4202496 155250 0 0 0 48866 24 0 0 25 0 1 0 979739878 217174016 52191 33554432000 4194304 4352236 140733848873664 18446744073709551615 4280978 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/18046/statm: 53021 52191 129 39 0 52101 0
[pid=18044/tid=18052] ppid=17988 vsize=1003888 CPUtime=0 cores=5,7
/proc/18044/task/18052/stat : 18052 (python) S 17988 17988 17918 0 -1 4202560 124 0 0 0 0 0 0 0 18 0 2 0 979749893 1027981312 184383 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604471130088384 0 0 -1 7 0 0 0
[pid=18060] ppid=17988 vsize=1003900 CPUtime=0.14 cores=5,7
/proc/18060/stat : 18060 (python) S 17988 17988 17918 0 -1 4202560 1083 0 0 0 6 8 0 0 19 0 2 0 979769617 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18060/statm: 250975 184367 399 364 0 186890 0
[pid=18062] ppid=18060 vsize=181712 CPUtime=99.95 cores=5,7
/proc/18062/stat : 18062 (lingeling) T 18060 18062 18062 0 -1 4202496 73253 0 0 0 9982 13 0 0 25 0 1 0 979769619 186073088 44598 33554432000 4194304 4352236 140734165502448 18446744073709551615 4280965 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/18062/statm: 45428 44598 129 39 0 44508 0
[pid=18060/tid=18065] ppid=17988 vsize=1003900 CPUtime=0 cores=5,7
/proc/18060/task/18065/stat : 18065 (python) S 17988 17988 17918 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 979779634 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604454223472448 0 0 -1 5 0 0 0
[pid=18075] ppid=17988 vsize=1014156 CPUtime=0.09 cores=5,7
/proc/18075/stat : 18075 (python) S 17988 17988 17918 0 -1 4202560 910 0 0 0 4 5 0 0 18 0 1 0 979798858 1038495744 184341 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284945990 0 0 16781312 514 13835286753700708616 0 0 17 5 0 0 0
/proc/18075/statm: 253539 184341 370 364 0 189451 0
[pid=18077] ppid=18075 vsize=890504 CPUtime=58.68 cores=5,7
/proc/18077/stat : 18077 (precosat) R 18075 18077 18077 0 -1 4202496 228600 0 0 0 5832 36 0 0 25 0 1 0 979798860 911876096 220685 33554432000 4194304 4890832 140737347041584 18446744073709551615 4274298 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/18077/statm: 222626 220685 86 171 0 222453 0
[pid=17988/tid=18045] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18045/stat : 18045 (python) S 17986 17988 17918 0 -1 4202560 36 924 0 10 0 0 0 0 18 0 4 0 979739878 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
[pid=17988/tid=18061] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18061/stat : 18061 (python) S 17986 17988 17918 0 -1 4202560 23 924 0 10 0 0 0 0 20 0 4 0 979769619 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
[pid=17988/tid=18076] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18076/stat : 18076 (python) S 17986 17988 17918 0 -1 4202560 26 924 0 10 0 0 0 0 20 0 4 0 979798860 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1159.87
Current children cumulated vsize (KiB) 5330644



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1222.5 s]
/proc/loadavg: 4.00 3.97 3.39 3/200 18081
/proc/meminfo: memFree=3991480/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1024400 CPUtime=511.43 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 1382521 924 39 10 50949 194 0 0 20 0 4 0 979686512 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 509
/proc/17988/statm: 256100 185847 1872 364 0 192012 0
[pid=18044] ppid=17988 vsize=1003888 CPUtime=0.68 cores=5,7
/proc/18044/stat : 18044 (python) S 17988 17988 17918 0 -1 4202560 1203 0 0 0 36 32 0 0 18 0 2 0 979739876 1027981312 184383 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18044/statm: 250972 184383 415 364 0 186890 0
[pid=18046] ppid=18044 vsize=212084 CPUtime=488.9 cores=5,7
/proc/18046/stat : 18046 (lingeling) T 18044 18046 18046 0 -1 4202496 155250 0 0 0 48866 24 0 0 25 0 1 0 979739878 217174016 52191 33554432000 4194304 4352236 140733848873664 18446744073709551615 4280978 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/18046/statm: 53021 52191 129 39 0 52101 0
[pid=18044/tid=18052] ppid=17988 vsize=1003888 CPUtime=0 cores=5,7
/proc/18044/task/18052/stat : 18052 (python) S 17988 17988 17918 0 -1 4202560 124 0 0 0 0 0 0 0 18 0 2 0 979749893 1027981312 184383 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604471130088384 0 0 -1 7 0 0 0
[pid=18060] ppid=17988 vsize=1003900 CPUtime=0.14 cores=5,7
/proc/18060/stat : 18060 (python) S 17988 17988 17918 0 -1 4202560 1083 0 0 0 6 8 0 0 19 0 2 0 979769617 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18060/statm: 250975 184367 399 364 0 186890 0
[pid=18062] ppid=18060 vsize=181712 CPUtime=99.95 cores=5,7
/proc/18062/stat : 18062 (lingeling) T 18060 18062 18062 0 -1 4202496 73253 0 0 0 9982 13 0 0 25 0 1 0 979769619 186073088 44598 33554432000 4194304 4352236 140734165502448 18446744073709551615 4280965 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/18062/statm: 45428 44598 129 39 0 44508 0
[pid=18060/tid=18065] ppid=17988 vsize=1003900 CPUtime=0 cores=5,7
/proc/18060/task/18065/stat : 18065 (python) S 17988 17988 17918 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 979779634 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604454223472448 0 0 -1 5 0 0 0
[pid=18075] ppid=17988 vsize=1014156 CPUtime=0.14 cores=5,7
/proc/18075/stat : 18075 (python) S 17988 17988 17918 0 -1 4202560 924 0 0 0 7 7 0 0 18 0 1 0 979798858 1038495744 184341 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284945990 0 0 16781312 514 13835286753700708616 0 0 17 5 0 0 0
/proc/18075/statm: 253539 184341 370 364 0 189451 0
[pid=18077] ppid=18075 vsize=890504 CPUtime=98.84 cores=5,7
/proc/18077/stat : 18077 (precosat) R 18075 18077 18077 0 -1 4202496 228651 0 0 0 9848 36 0 0 25 0 1 0 979798860 911876096 220736 33554432000 4194304 4890832 140737347041584 18446744073709551615 4238265 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/18077/statm: 222626 220736 86 171 0 222453 0
[pid=17988/tid=18045] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18045/stat : 18045 (python) S 17986 17988 17918 0 -1 4202560 36 924 0 10 0 0 0 0 18 0 4 0 979739878 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
[pid=17988/tid=18061] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18061/stat : 18061 (python) S 17986 17988 17918 0 -1 4202560 23 924 0 10 0 0 0 0 20 0 4 0 979769619 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
[pid=17988/tid=18076] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18076/stat : 18076 (python) S 17986 17988 17918 0 -1 4202560 26 924 0 10 0 0 0 0 20 0 4 0 979798860 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 5330644

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1222.5 s]
/proc/loadavg: 4.00 3.97 3.39 3/200 18081
/proc/meminfo: memFree=3991480/32951124 swapFree=67049472/67111528
[pid=17988] ppid=17986 vsize=1024400 CPUtime=511.43 cores=5,7
/proc/17988/stat : 17988 (python) S 17986 17988 17918 0 -1 4202496 1382521 924 39 10 50949 194 0 0 20 0 4 0 979686512 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 509
/proc/17988/statm: 256100 185847 1872 364 0 192012 0
[pid=18044] ppid=17988 vsize=1003888 CPUtime=0.68 cores=5,7
/proc/18044/stat : 18044 (python) S 17988 17988 17918 0 -1 4202560 1203 0 0 0 36 32 0 0 18 0 2 0 979739876 1027981312 184383 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18044/statm: 250972 184383 415 364 0 186890 0
[pid=18046] ppid=18044 vsize=212084 CPUtime=488.9 cores=5,7
/proc/18046/stat : 18046 (lingeling) T 18044 18046 18046 0 -1 4202496 155250 0 0 0 48866 24 0 0 25 0 1 0 979739878 217174016 52191 33554432000 4194304 4352236 140733848873664 18446744073709551615 4280978 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/18046/statm: 53021 52191 129 39 0 52101 0
[pid=18044/tid=18052] ppid=17988 vsize=1003888 CPUtime=0 cores=5,7
/proc/18044/task/18052/stat : 18052 (python) S 17988 17988 17918 0 -1 4202560 124 0 0 0 0 0 0 0 18 0 2 0 979749893 1027981312 184383 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604471130088384 0 0 -1 7 0 0 0
[pid=18060] ppid=17988 vsize=1003900 CPUtime=0.14 cores=5,7
/proc/18060/stat : 18060 (python) S 17988 17988 17918 0 -1 4202560 1083 0 0 0 6 8 0 0 19 0 2 0 979769617 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18060/statm: 250975 184367 399 364 0 186890 0
[pid=18062] ppid=18060 vsize=181712 CPUtime=99.95 cores=5,7
/proc/18062/stat : 18062 (lingeling) T 18060 18062 18062 0 -1 4202496 73253 0 0 0 9982 13 0 0 25 0 1 0 979769619 186073088 44598 33554432000 4194304 4352236 140734165502448 18446744073709551615 4280965 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/18062/statm: 45428 44598 129 39 0 44508 0
[pid=18060/tid=18065] ppid=17988 vsize=1003900 CPUtime=0 cores=5,7
/proc/18060/task/18065/stat : 18065 (python) S 17988 17988 17918 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 979779634 1027993600 184367 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 514 18446604454223472448 0 0 -1 5 0 0 0
[pid=18075] ppid=17988 vsize=1014156 CPUtime=0.14 cores=5,7
/proc/18075/stat : 18075 (python) S 17988 17988 17918 0 -1 4202560 924 0 0 0 7 7 0 0 18 0 1 0 979798858 1038495744 184341 33554432000 4194304 5683644 140733373163104 18446744073709551615 224284945990 0 0 16781312 514 13835286753700708616 0 0 17 5 0 0 0
/proc/18075/statm: 253539 184341 370 364 0 189451 0
[pid=18077] ppid=18075 vsize=890504 CPUtime=98.84 cores=5,7
/proc/18077/stat : 18077 (precosat) R 18075 18077 18077 0 -1 4202496 228651 0 0 0 9848 36 0 0 25 0 1 0 979798860 911876096 220736 33554432000 4194304 4890832 140737347041584 18446744073709551615 4238265 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/18077/statm: 222626 220736 86 171 0 222453 0
[pid=17988/tid=18045] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18045/stat : 18045 (python) S 17986 17988 17918 0 -1 4202560 36 924 0 10 0 0 0 0 18 0 4 0 979739878 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
[pid=17988/tid=18061] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18061/stat : 18061 (python) S 17986 17988 17918 0 -1 4202560 23 924 0 10 0 0 0 0 20 0 4 0 979769619 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 5 0 0 0
[pid=17988/tid=18076] ppid=17986 vsize=1024400 CPUtime=0 cores=5,7
/proc/17988/task/18076/stat : 18076 (python) S 17986 17988 17918 0 -1 4202560 26 924 0 10 0 0 0 0 20 0 4 0 979798860 1048985600 185847 33554432000 4194304 5683644 140733373163104 18446744073709551615 224296749489 0 0 16781312 2 18446604459871402880 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 5330644

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 17988 and gives
#  childrusage.ru_utime.tv_sec=509
#  childrusage.ru_utime.tv_usec=495544
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=987697
# CPU time returned by wait4() is 511.483
# while last known CPU time is 1200.08
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1222.58
CPU time (s): 1200.08
CPU user time (s): 1196.94
CPU system time (s): 3.14
CPU usage (%): 98.1598
Max. virtual memory (cumulated for all children) (KiB): 5330648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 509.496
system time used= 1.9877
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1383446
page faults= 49
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12316
involuntary context switches= 6620

runsolver used 2.16867 second user time and 4.79227 second system time

The end

Launcher Data 

Begin job on node118 at 2011-06-12 18:02:38
IDJOB=3483913
IDBENCH=82371
IDSOLVER=1976
FILE ID=node118/3483913-1307894553
RUNJOBID= node118-1307894553-17939
PBS_JOBID= 13559533
Free space on /tmp= 17792 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed, 1200 s timeout)
BENCH NAME= SAT11/application/rintanen/SATPlanning/blocks-blocks-36-0.120-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3483913-1307894553/watcher-3483913-1307894553 -o /tmp/evaluation-result-3483913-1307894553/solver-3483913-1307894553 -C 1200 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3483913-1307894553.cnf -seed 1379018934 -budget 1200

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 8d94c04f870c828c80bd9a45ae3dedff
RANDOM SEED=1379018934

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       1243296 kB
Buffers:         56772 kB
Cached:       30630068 kB
SwapCached:      14364 kB
Active:       15769924 kB
Inactive:     14964240 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       1243296 kB
SwapTotal:    67111528 kB
SwapFree:     67049472 kB
Dirty:          474916 kB
Writeback:           0 kB
AnonPages:       45932 kB
Mapped:          11768 kB
Slab:           908100 kB
PageTables:       6028 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   262532 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 17764 MiB
End job on node118 at 2011-06-12 18:23:03