Trace number 3317705

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 1589.9 1020.58

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf
MD5SUM5d1253e2dcc0e3e55992672756beadbc
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2074.86
Satisfiable
(Un)Satisfiability was proved
Number of variables756832
Number of clauses4116966
Sum of the clauses size9765566
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 24082840
Number of clauses of size 3640
Number of clauses of size 4800
Number of clauses of size 5800
Number of clauses of size over 531040

Solver Data 

0.37/2.27	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.37/2.27	c INFO: solving HOME/instance-3317705-1304268702.cnf
0.37/2.27	c INFO: computing task features
17.56/19.46	c INFO: computed variable-clause graph statistics
18.05/19.95	c INFO: computed clause balance statistics
76.45/78.35	c INFO: computed variable balance statistics
121.55/123.41	c INFO: computed small-clause counts
125.16/127.06	c INFO: computed Horn-clause counts
827.67/829.57	c INFO: computed variable graph statistics
827.67/829.58	c INFO: collected features for HOME/instance-3317705-1304268702.cnf in 826.35 s
827.77/829.60	c INFO: running cryptominisat-2.9.0@0 for 1261 with 3972 remaining (b = 0.61)
827.77/829.63	c INFO: running lingeling-276@0 for 388 with 3972 remaining (b = 0.35)
827.77/829.66	c INFO: running lingeling-276@0 for 97 with 3972 remaining (b = 0.16)
827.77/829.69	c INFO: running cryptominisat-2.9.0@0 for 1940 with 3972 remaining (b = 0.55)
1227.67/929.87	c INFO: running cryptominisat-2.9.0@0 for 1843 with 3872 remaining (b = 0.43)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317705-1304268702/watcher-3317705-1304268702 -o /tmp/evaluation-result-3317705-1304268702/solver-3317705-1304268702 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317705-1304268702.cnf -seed 30873738 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.91 6.71 5.75 2/188 9823
/proc/meminfo: memFree=22975740/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/9823/stat : 9823 (python) S 9821 9823 9574 0 -1 4202496 727 0 0 0 0 0 0 0 21 0 1 0 538468649 15548416 617 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/9823/statm: 3796 617 322 364 0 283 0

[startup+0.00754489 s]
/proc/loadavg: 4.91 6.71 5.75 2/188 9823
/proc/meminfo: memFree=22975740/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=15380 CPUtime=0 cores=0,2,4,6
/proc/9823/stat : 9823 (python) S 9821 9823 9574 0 -1 4202496 791 0 0 0 0 0 0 0 21 0 1 0 538468649 15749120 679 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 4 0 0 0
/proc/9823/statm: 3846 680 322 364 0 333 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15380

[startup+0.101496 s]
/proc/loadavg: 4.91 6.71 5.75 2/188 9823
/proc/meminfo: memFree=22975740/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=91832 CPUtime=0.06 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 2678 0 0 0 4 2 0 0 21 0 1 0 538468649 94035968 2394 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335890432 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9823/statm: 22958 2394 755 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 91832

[startup+0.808384 s]
/proc/loadavg: 4.91 6.71 5.75 2/188 9823
/proc/meminfo: memFree=22975740/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=157384 CPUtime=0.28 cores=0,2,4,6
/proc/9823/stat : 9823 (python) D 9821 9823 9574 0 -1 4202496 6588 935 1 0 20 8 0 0 17 0 1 0 538468649 161161216 4696 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335898167 0 0 16781312 2 18446744071562154983 0 0 17 4 0 0 0
/proc/9823/statm: 39346 4696 1257 364 0 3454 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 157384

[startup+0.900366 s]
/proc/loadavg: 4.91 6.71 5.75 2/188 9823
/proc/meminfo: memFree=22975740/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=157384 CPUtime=0.28 cores=0,2,4,6
/proc/9823/stat : 9823 (python) D 9821 9823 9574 0 -1 4202496 6588 935 1 0 20 8 0 0 17 0 1 0 538468649 161161216 4696 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335898167 0 0 16781312 2 18446744071562154983 0 0 17 4 0 0 0
/proc/9823/statm: 39346 4696 1257 364 0 3454 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 157384

[startup+1.50026 s]
/proc/loadavg: 4.91 6.71 5.75 2/188 9823
/proc/meminfo: memFree=22975740/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=157384 CPUtime=0.28 cores=0,2,4,6
/proc/9823/stat : 9823 (python) D 9821 9823 9574 0 -1 4202496 6588 935 1 0 20 8 0 0 17 0 1 0 538468649 161161216 4696 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335898167 0 0 16781312 2 18446744071562154983 0 0 17 4 0 0 0
/proc/9823/statm: 39346 4696 1257 364 0 3454 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 157384

[startup+3.10097 s]
/proc/loadavg: 4.92 6.68 5.75 3/189 9828
/proc/meminfo: memFree=22846952/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=411388 CPUtime=1.25 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 42184 935 1 0 108 17 0 0 17 0 1 0 538468649 421261312 39865 33554432000 4194304 5683644 140734394824096 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 4 0 0 160
/proc/9823/statm: 102847 39865 1761 364 0 38771 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 411388
heavy processes:

[startup+6.30043 s]
/proc/loadavg: 4.69 6.60 5.73 3/189 9828
/proc/meminfo: memFree=22627592/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=635684 CPUtime=4.45 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 96093 935 1 0 421 24 0 0 24 0 1 0 538468649 650940416 93774 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335553221 0 0 16781312 2 0 0 0 17 4 0 0 160
/proc/9823/statm: 158921 93775 1761 364 0 94845 0
Current children cumulated CPU time (s) 4.45
Current children cumulated vsize (KiB) 635684
heavy processes:

[startup+12.7073 s]
/proc/loadavg: 4.47 6.53 5.71 3/189 9828
/proc/meminfo: memFree=22293272/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=789120 CPUtime=10.86 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 203718 935 1 0 1046 40 0 0 25 0 1 0 538468649 808058880 133750 33554432000 4194304 5683644 140734394824096 18446744073709551615 4438566 0 0 16781312 2 0 0 0 17 4 0 0 160
/proc/9823/statm: 197280 133750 1764 364 0 133204 0
Current children cumulated CPU time (s) 10.86
Current children cumulated vsize (KiB) 789120

[startup+25.501 s]
/proc/loadavg: 4.09 6.38 5.67 3/189 9829
/proc/meminfo: memFree=22242412/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=23.65 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 539300 935 1 0 2285 80 0 0 25 0 1 0 538468649 1013112832 184758 33554432000 4194304 5683644 140734394824096 18446744073709551615 232339301045 0 0 16781312 2 0 0 0 17 4 0 0 160
/proc/9823/statm: 247342 184758 1826 364 0 183266 0
Current children cumulated CPU time (s) 23.65
Current children cumulated vsize (KiB) 989368

[startup+51.1004 s]
/proc/loadavg: 3.27 5.96 5.55 3/189 9829
/proc/meminfo: memFree=22242584/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=49.26 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 539300 935 1 0 4846 80 0 0 25 0 1 0 538468649 1013112832 184758 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223435457553 0 0 16781312 2 0 0 0 17 4 0 0 160
/proc/9823/statm: 247342 184758 1826 364 0 183266 0
Current children cumulated CPU time (s) 49.26
Current children cumulated vsize (KiB) 989368

[startup+102.3 s]
/proc/loadavg: 2.55 5.35 5.36 3/189 9831
/proc/meminfo: memFree=22242648/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=100.45 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 539301 935 1 0 9965 80 0 0 25 0 1 0 538468649 1013112832 184759 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335547400 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184759 1827 364 0 183266 0
Current children cumulated CPU time (s) 100.45
Current children cumulated vsize (KiB) 989368

[startup+162.307 s]
/proc/loadavg: 2.58 4.84 5.18 3/189 9876
/proc/meminfo: memFree=23520648/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=160.46 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 747957 935 1 0 15939 107 0 0 25 0 1 0 538468649 1013112832 184765 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223428024460 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184765 1833 364 0 183266 0
Current children cumulated CPU time (s) 160.46
Current children cumulated vsize (KiB) 989368

[startup+222.301 s]
/proc/loadavg: 2.26 4.34 4.99 3/189 9878
/proc/meminfo: memFree=23469096/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=220.45 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 747957 935 1 0 21938 107 0 0 25 0 1 0 538468649 1013112832 184765 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223428024448 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184765 1833 364 0 183266 0
Current children cumulated CPU time (s) 220.45
Current children cumulated vsize (KiB) 989368

[startup+282.3 s]
/proc/loadavg: 2.76 4.06 4.85 8/201 9891
/proc/meminfo: memFree=22684232/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=280.45 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 747957 935 1 0 27938 107 0 0 25 0 1 0 538468649 1013112832 184765 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223428024448 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184765 1833 364 0 183266 0
Current children cumulated CPU time (s) 280.45
Current children cumulated vsize (KiB) 989368

[startup+342.301 s]
/proc/loadavg: 4.22 4.24 4.86 7/201 9893
/proc/meminfo: memFree=22242332/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=340.45 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 747957 935 1 0 33938 107 0 0 25 0 1 0 538468649 1013112832 184765 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223428024460 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184765 1833 364 0 183266 0
Current children cumulated CPU time (s) 340.45
Current children cumulated vsize (KiB) 989368

[startup+402.301 s]
/proc/loadavg: 4.80 4.41 4.87 7/206 9900
/proc/meminfo: memFree=20999900/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=400.45 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 747957 935 1 0 39938 107 0 0 25 0 1 0 538468649 1013112832 184765 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223428024460 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184765 1833 364 0 183266 0
Current children cumulated CPU time (s) 400.45
Current children cumulated vsize (KiB) 989368

[startup+462.3 s]
/proc/loadavg: 4.97 4.53 4.88 7/206 9901
/proc/meminfo: memFree=20638636/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=460.45 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 747957 935 1 0 45938 107 0 0 25 0 1 0 538468649 1013112832 184765 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223428024460 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184765 1833 364 0 183266 0
Current children cumulated CPU time (s) 460.45
Current children cumulated vsize (KiB) 989368

[startup+522.3 s]
/proc/loadavg: 5.03 4.62 4.90 7/206 9903
/proc/meminfo: memFree=19781264/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=520.46 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 747957 935 1 0 51939 107 0 0 25 0 1 0 538468649 1013112832 184765 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223428024448 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184765 1833 364 0 183266 0
Current children cumulated CPU time (s) 520.46
Current children cumulated vsize (KiB) 989368

[startup+582.301 s]
/proc/loadavg: 5.09 4.71 4.91 7/206 9913
/proc/meminfo: memFree=19299828/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=989368 CPUtime=580.46 cores=0,2,4,6
/proc/9823/stat : 9823 (python) R 9821 9823 9574 0 -1 4202496 747957 935 1 0 57939 107 0 0 25 0 1 0 538468649 1013112832 184765 33554432000 4194304 5683644 140734394824096 18446744073709551615 47223428024460 0 0 16781312 2 0 0 0 17 0 0 0 160
/proc/9823/statm: 247342 184765 1833 364 0 183266 0
Current children cumulated CPU time (s) 580.46
Current children cumulated vsize (KiB) 989368

################
# More data... #
################

/proc/9823/statm: 187000 111671 1884 364 0 122906 0
[pid=9929] ppid=9823 vsize=696732 CPUtime=0.4 cores=0,2,4,6
/proc/9929/stat : 9929 (python) S 9823 9823 9574 0 -1 4202560 1367 0 0 0 23 17 0 0 15 0 1 0 538551610 713453568 110149 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912463 0 0 16781312 514 5159361560610570500 0 0 17 2 0 0 0
/proc/9929/statm: 174183 110149 382 364 0 110101 0
[pid=9931] ppid=9929 vsize=4611548 CPUtime=172.41 cores=0,2,4,6
/proc/9931/stat : 9931 (cryptominisat-2) R 9929 9931 9931 0 -1 4202496 6476480 0 0 0 16316 925 0 0 25 0 1 0 538551611 4722225152 1074249 33554432000 4194304 4677096 140734851247872 18446744073709551615 4395229 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/9931/statm: 1152887 1074257 390 118 0 1147846 0
[pid=9932] ppid=9823 vsize=706988 CPUtime=0.26 cores=0,2,4,6
/proc/9932/stat : 9932 (python) S 9823 9823 9574 0 -1 4202560 964 0 0 0 14 12 0 0 18 0 1 0 538551613 723955712 110141 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 909041029473075460 0 0 17 0 0 0 0
/proc/9932/statm: 176747 110141 370 364 0 112662 0
[pid=9934] ppid=9932 vsize=164868 CPUtime=172.47 cores=0,2,4,6
/proc/9934/stat : 9934 (lingeling) R 9932 9934 9934 0 -1 4202496 81929 0 0 0 17234 13 0 0 25 0 1 0 538551614 168824832 40387 33554432000 4194304 4352236 140736068048576 18446744073709551615 4207627 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/9934/statm: 41217 40387 129 39 0 40297 0
[pid=9935] ppid=9823 vsize=717244 CPUtime=0.15 cores=0,2,4,6
/proc/9935/stat : 9935 (python) S 9823 9823 9574 0 -1 4202560 1099 0 0 0 7 8 0 0 19 0 2 0 538551616 734457856 110175 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/9935/statm: 179311 110175 399 364 0 115223 0
[pid=9937] ppid=9935 vsize=148568 CPUtime=99.21 cores=0,2,4,6
/proc/9937/stat : 9937 (lingeling) T 9935 9937 9937 0 -1 4202496 69359 0 0 0 9908 13 0 0 25 0 1 0 538551617 152133632 36312 33554432000 4194304 4352236 140736177660704 18446744073709551615 4207584 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/9937/statm: 37142 36312 129 39 0 36222 0
[pid=9935/tid=9948] ppid=9823 vsize=717244 CPUtime=0 cores=0,2,4,6
/proc/9935/task/9948/stat : 9948 (python) S 9823 9823 9574 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538561635 734457856 110175 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 514 18446604453188238208 0 0 -1 6 0 0 0
[pid=9938] ppid=9823 vsize=727500 CPUtime=0.42 cores=0,2,4,6
/proc/9938/stat : 9938 (python) S 9823 9823 9574 0 -1 4202560 1277 0 0 0 27 15 0 0 15 0 1 0 538551618 744960000 110150 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 5641673331250790660 0 0 17 6 0 0 0
/proc/9938/statm: 181875 110150 371 364 0 117784 0
[pid=9940] ppid=9938 vsize=3997292 CPUtime=171.59 cores=0,2,4,6
/proc/9940/stat : 9940 (cryptominisat-2) R 9938 9940 9940 0 -1 4202496 5380983 0 0 0 16378 781 0 0 25 0 1 0 538551620 4093227008 924785 33554432000 4194304 4677096 140733818977936 18446744073709551615 4293307 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/9940/statm: 999323 924785 390 118 0 994282 0
[pid=9949] ppid=9823 vsize=737756 CPUtime=0.11 cores=0,2,4,6
/proc/9949/stat : 9949 (python) S 9823 9823 9574 0 -1 4202560 966 0 0 0 5 6 0 0 15 0 1 0 538561637 755462144 110153 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 909041029473075460 0 0 17 4 0 0 0
/proc/9949/statm: 184439 110153 370 364 0 120345 0
[pid=9951] ppid=9949 vsize=1092124 CPUtime=72.28 cores=0,2,4,6
/proc/9951/stat : 9951 (cryptominisat-2) R 9949 9951 9951 0 -1 4202496 250421 0 0 0 7184 44 0 0 25 0 1 0 538561638 1118334976 217220 33554432000 4194304 4677096 140735573327808 18446744073709551615 4336189 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9951/statm: 273031 217220 387 118 0 267990 0
[pid=9823/tid=9930] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9930/stat : 9930 (python) S 9821 9823 9574 0 -1 4202560 108 935 0 0 0 0 0 0 25 0 6 0 538551611 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9933] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9933/stat : 9933 (python) S 9821 9823 9574 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 6 0 538551614 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9936] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9936/stat : 9936 (python) S 9821 9823 9574 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 6 0 538551617 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9939] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9939/stat : 9939 (python) S 9821 9823 9574 0 -1 4202560 27 935 0 0 0 0 0 0 25 0 6 0 538551620 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 0 0 0 0
[pid=9823/tid=9950] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9950/stat : 9950 (python) S 9821 9823 9574 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 6 0 538561638 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1517.2
Current children cumulated vsize (KiB) 14348620



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1020.5 s]
/proc/loadavg: 8.05 6.45 5.53 9/232 9954
/proc/meminfo: memFree=6788768/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=748000 CPUtime=827.9 cores=0,2,4,6
/proc/9823/stat : 9823 (python) S 9821 9823 9574 0 -1 4202496 751434 935 1 0 82674 116 0 0 20 0 6 0 538468649 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 160
/proc/9823/statm: 187000 111671 1884 364 0 122906 0
[pid=9929] ppid=9823 vsize=696732 CPUtime=0.47 cores=0,2,4,6
/proc/9929/stat : 9929 (python) S 9823 9823 9574 0 -1 4202560 1382 0 0 0 28 19 0 0 15 0 1 0 538551610 713453568 110149 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912463 0 0 16781312 514 5159361560610570500 0 0 17 2 0 0 0
/proc/9929/statm: 174183 110149 382 364 0 110101 0
[pid=9931] ppid=9929 vsize=5298636 CPUtime=190.55 cores=0,2,4,6
/proc/9931/stat : 9931 (cryptominisat-2) R 9929 9931 9931 0 -1 4202496 7850670 0 0 0 17879 1176 0 0 25 0 1 0 538551611 5425803264 1242921 33554432000 4194304 4677096 140734851247872 18446744073709551615 4395229 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/9931/statm: 1324659 1242929 390 118 0 1319618 0
[pid=9932] ppid=9823 vsize=706988 CPUtime=0.29 cores=0,2,4,6
/proc/9932/stat : 9932 (python) S 9823 9823 9574 0 -1 4202560 970 0 0 0 16 13 0 0 18 0 1 0 538551613 723955712 110141 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 909041029473075460 0 0 17 0 0 0 0
/proc/9932/statm: 176747 110141 370 364 0 112662 0
[pid=9934] ppid=9932 vsize=164868 CPUtime=190.65 cores=0,2,4,6
/proc/9934/stat : 9934 (lingeling) R 9932 9934 9934 0 -1 4202496 81929 0 0 0 19052 13 0 0 25 0 1 0 538551614 168824832 40387 33554432000 4194304 4352236 140736068048576 18446744073709551615 4207627 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/9934/statm: 41217 40387 129 39 0 40297 0
[pid=9935] ppid=9823 vsize=717244 CPUtime=0.15 cores=0,2,4,6
/proc/9935/stat : 9935 (python) S 9823 9823 9574 0 -1 4202560 1099 0 0 0 7 8 0 0 19 0 2 0 538551616 734457856 110175 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/9935/statm: 179311 110175 399 364 0 115223 0
[pid=9937] ppid=9935 vsize=148568 CPUtime=99.21 cores=0,2,4,6
/proc/9937/stat : 9937 (lingeling) T 9935 9937 9937 0 -1 4202496 69359 0 0 0 9908 13 0 0 25 0 1 0 538551617 152133632 36312 33554432000 4194304 4352236 140736177660704 18446744073709551615 4207584 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/9937/statm: 37142 36312 129 39 0 36222 0
[pid=9935/tid=9948] ppid=9823 vsize=717244 CPUtime=0 cores=0,2,4,6
/proc/9935/task/9948/stat : 9948 (python) S 9823 9823 9574 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538561635 734457856 110175 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 514 18446604453188238208 0 0 -1 6 0 0 0
[pid=9938] ppid=9823 vsize=727500 CPUtime=0.47 cores=0,2,4,6
/proc/9938/stat : 9938 (python) S 9823 9823 9574 0 -1 4202560 1294 0 0 0 30 17 0 0 15 0 1 0 538551618 744960000 110150 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 5641673331250790660 0 0 17 6 0 0 0
/proc/9938/statm: 181875 110150 371 364 0 117784 0
[pid=9940] ppid=9938 vsize=4769408 CPUtime=189.61 cores=0,2,4,6
/proc/9940/stat : 9940 (cryptominisat-2) R 9938 9940 9940 0 -1 4202496 6712435 0 0 0 17929 1032 0 0 25 0 1 0 538551620 4883873792 1117814 33554432000 4194304 4677096 140733818977936 18446744073709551615 4293843 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/9940/statm: 1192352 1117814 390 118 0 1187311 0
[pid=9949] ppid=9823 vsize=737756 CPUtime=0.15 cores=0,2,4,6
/proc/9949/stat : 9949 (python) S 9823 9823 9574 0 -1 4202560 974 0 0 0 7 8 0 0 15 0 1 0 538561637 755462144 110153 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 909041029473075460 0 0 17 4 0 0 0
/proc/9949/statm: 184439 110153 370 364 0 120345 0
[pid=9951] ppid=9949 vsize=1163548 CPUtime=90.45 cores=0,2,4,6
/proc/9951/stat : 9951 (cryptominisat-2) R 9949 9951 9951 0 -1 4202496 258646 0 0 0 8998 47 0 0 25 0 1 0 538561638 1191473152 225445 33554432000 4194304 4677096 140735573327808 18446744073709551615 4336479 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9951/statm: 290887 225445 387 118 0 285846 0
[pid=9823/tid=9930] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9930/stat : 9930 (python) S 9821 9823 9574 0 -1 4202560 108 935 0 0 0 0 0 0 25 0 6 0 538551611 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9933] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9933/stat : 9933 (python) S 9821 9823 9574 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 6 0 538551614 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9936] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9936/stat : 9936 (python) S 9821 9823 9574 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 6 0 538551617 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9939] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9939/stat : 9939 (python) S 9821 9823 9574 0 -1 4202560 27 935 0 0 0 0 0 0 25 0 6 0 538551620 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 0 0 0 0
[pid=9823/tid=9950] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9950/stat : 9950 (python) S 9821 9823 9574 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 6 0 538561638 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1589.9
Current children cumulated vsize (KiB) 15879248

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1020.5 s]
/proc/loadavg: 8.05 6.45 5.53 9/232 9954
/proc/meminfo: memFree=6788768/32951124 swapFree=67111412/67111528
[pid=9823] ppid=9821 vsize=748000 CPUtime=827.9 cores=0,2,4,6
/proc/9823/stat : 9823 (python) S 9821 9823 9574 0 -1 4202496 751434 935 1 0 82674 116 0 0 20 0 6 0 538468649 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 160
/proc/9823/statm: 187000 111671 1884 364 0 122906 0
[pid=9929] ppid=9823 vsize=696732 CPUtime=0.47 cores=0,2,4,6
/proc/9929/stat : 9929 (python) S 9823 9823 9574 0 -1 4202560 1382 0 0 0 28 19 0 0 15 0 1 0 538551610 713453568 110149 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912463 0 0 16781312 514 5159361560610570500 0 0 17 2 0 0 0
/proc/9929/statm: 174183 110149 382 364 0 110101 0
[pid=9931] ppid=9929 vsize=5298636 CPUtime=190.55 cores=0,2,4,6
/proc/9931/stat : 9931 (cryptominisat-2) R 9929 9931 9931 0 -1 4202496 7850670 0 0 0 17879 1176 0 0 25 0 1 0 538551611 5425803264 1242921 33554432000 4194304 4677096 140734851247872 18446744073709551615 4395229 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/9931/statm: 1324659 1242929 390 118 0 1319618 0
[pid=9932] ppid=9823 vsize=706988 CPUtime=0.29 cores=0,2,4,6
/proc/9932/stat : 9932 (python) S 9823 9823 9574 0 -1 4202560 970 0 0 0 16 13 0 0 18 0 1 0 538551613 723955712 110141 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 909041029473075460 0 0 17 0 0 0 0
/proc/9932/statm: 176747 110141 370 364 0 112662 0
[pid=9934] ppid=9932 vsize=164868 CPUtime=190.65 cores=0,2,4,6
/proc/9934/stat : 9934 (lingeling) R 9932 9934 9934 0 -1 4202496 81929 0 0 0 19052 13 0 0 25 0 1 0 538551614 168824832 40387 33554432000 4194304 4352236 140736068048576 18446744073709551615 4207627 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/9934/statm: 41217 40387 129 39 0 40297 0
[pid=9935] ppid=9823 vsize=717244 CPUtime=0.15 cores=0,2,4,6
/proc/9935/stat : 9935 (python) S 9823 9823 9574 0 -1 4202560 1099 0 0 0 7 8 0 0 19 0 2 0 538551616 734457856 110175 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/9935/statm: 179311 110175 399 364 0 115223 0
[pid=9937] ppid=9935 vsize=148568 CPUtime=99.21 cores=0,2,4,6
/proc/9937/stat : 9937 (lingeling) T 9935 9937 9937 0 -1 4202496 69359 0 0 0 9908 13 0 0 25 0 1 0 538551617 152133632 36312 33554432000 4194304 4352236 140736177660704 18446744073709551615 4207584 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/9937/statm: 37142 36312 129 39 0 36222 0
[pid=9935/tid=9948] ppid=9823 vsize=717244 CPUtime=0 cores=0,2,4,6
/proc/9935/task/9948/stat : 9948 (python) S 9823 9823 9574 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538561635 734457856 110175 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 514 18446604453188238208 0 0 -1 6 0 0 0
[pid=9938] ppid=9823 vsize=727500 CPUtime=0.47 cores=0,2,4,6
/proc/9938/stat : 9938 (python) S 9823 9823 9574 0 -1 4202560 1294 0 0 0 30 17 0 0 15 0 1 0 538551618 744960000 110150 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 5641673331250790660 0 0 17 6 0 0 0
/proc/9938/statm: 181875 110150 371 364 0 117784 0
[pid=9940] ppid=9938 vsize=4769408 CPUtime=189.61 cores=0,2,4,6
/proc/9940/stat : 9940 (cryptominisat-2) R 9938 9940 9940 0 -1 4202496 6712435 0 0 0 17929 1032 0 0 25 0 1 0 538551620 4883873792 1117814 33554432000 4194304 4677096 140733818977936 18446744073709551615 4293843 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/9940/statm: 1192352 1117814 390 118 0 1187311 0
[pid=9949] ppid=9823 vsize=737756 CPUtime=0.15 cores=0,2,4,6
/proc/9949/stat : 9949 (python) S 9823 9823 9574 0 -1 4202560 974 0 0 0 7 8 0 0 15 0 1 0 538561637 755462144 110153 33554432000 4194304 5683644 140734394824096 18446744073709551615 232335912518 0 0 16781312 514 909041029473075460 0 0 17 4 0 0 0
/proc/9949/statm: 184439 110153 370 364 0 120345 0
[pid=9951] ppid=9949 vsize=1163548 CPUtime=90.45 cores=0,2,4,6
/proc/9951/stat : 9951 (cryptominisat-2) R 9949 9951 9951 0 -1 4202496 258646 0 0 0 8998 47 0 0 25 0 1 0 538561638 1191473152 225445 33554432000 4194304 4677096 140735573327808 18446744073709551615 4336479 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9951/statm: 290887 225445 387 118 0 285846 0
[pid=9823/tid=9930] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9930/stat : 9930 (python) S 9821 9823 9574 0 -1 4202560 108 935 0 0 0 0 0 0 25 0 6 0 538551611 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9933] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9933/stat : 9933 (python) S 9821 9823 9574 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 6 0 538551614 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9936] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9936/stat : 9936 (python) S 9821 9823 9574 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 6 0 538551617 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 6 0 0 0
[pid=9823/tid=9939] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9939/stat : 9939 (python) S 9821 9823 9574 0 -1 4202560 27 935 0 0 0 0 0 0 25 0 6 0 538551620 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 0 0 0 0
[pid=9823/tid=9950] ppid=9821 vsize=748000 CPUtime=0 cores=0,2,4,6
/proc/9823/task/9950/stat : 9950 (python) S 9821 9823 9574 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 6 0 538561638 765952000 111671 33554432000 4194304 5683644 140734394824096 18446744073709551615 232347716017 0 0 16781312 2 18446604453807958912 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1589.9
Current children cumulated vsize (KiB) 15879248

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 9823 and gives
#  childrusage.ru_utime.tv_sec=826
#  childrusage.ru_utime.tv_usec=748315
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=204816
# CPU time returned by wait4() is 827.953
# while last known CPU time is 1589.9
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1020.58
CPU time (s): 1589.9
CPU user time (s): 1565.28
CPU system time (s): 24.62
CPU usage (%): 155.784
Max. virtual memory (cumulated for all children) (KiB): 15879248

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 826.748
system time used= 1.20482
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 752372
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2902
involuntary context switches= 1674

runsolver used 1.80272 second user time and 3.90441 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-01 18:51:45
IDJOB=3317705
IDBENCH=82387
IDSOLVER=1706
FILE ID=node132/3317705-1304268702
RUNJOBID= node132-1304267281-9592
PBS_JOBID= 13173947
Free space on /tmp= 71900 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317705-1304268702/watcher-3317705-1304268702 -o /tmp/evaluation-result-3317705-1304268702/solver-3317705-1304268702 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317705-1304268702.cnf -seed 30873738 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5d1253e2dcc0e3e55992672756beadbc
RANDOM SEED=30873738

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22976020 kB
Buffers:        704468 kB
Cached:        6290748 kB
SwapCached:        112 kB
Active:        4368912 kB
Inactive:      5112188 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22976020 kB
SwapTotal:    67111528 kB
SwapFree:     67111412 kB
Dirty:          110412 kB
Writeback:           0 kB
AnonPages:     2485936 kB
Mapped:          22088 kB
Slab:           425972 kB
PageTables:      10328 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2664280 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71980 MiB
End job on node132 at 2011-05-01 19:08:47