Trace number 3380725

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)? (MO) 2789.01 1581.84

General information on the benchmark

Namevelev-npe-1.0-9dlx-b71.cnf
MD5SUM75d91f0ba4398ccb5b452707c0e7fa27
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark22.1306
Satisfiable
(Un)Satisfiability was proved
Number of variables889302
Number of clauses14582074
Sum of the clauses size42006170
Maximum clause length5391
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 212803954
Number of clauses of size 3913633
Number of clauses of size 418493
Number of clauses of size 536153
Number of clauses of size over 5809840

Solver Data 

0.35/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.35/0.68	c INFO: solving HOME/instance-3380725-1305490323.cnf
0.35/0.68	c INFO: computing task features
78.85/79.13	c INFO: computed variable-clause graph statistics
80.74/81.02	c INFO: computed clause balance statistics
303.95/304.23	c INFO: computed variable balance statistics
459.57/459.84	c INFO: computed small-clause counts
473.05/473.39	c INFO: computed Horn-clause counts
1408.09/1408.36	c INFO: computed variable graph statistics
1408.18/1408.41	c INFO: collected features for HOME/instance-3380725-1305490323.cnf in 1403.67 s
1408.18/1408.44	c INFO: running lingeling-276@0 for 97 with 3592 remaining (b = 0.80)
1408.18/1408.49	c INFO: running precosat-570@0 for 97 with 3592 remaining (b = 0.69)
1408.28/1408.55	c INFO: running lingeling-276@0 for 97 with 3592 remaining (b = 0.60)
1408.38/1408.60	c INFO: running lingeling-276@0 for 485 with 3592 remaining (b = 0.90)
1408.38/1408.65	c INFO: running glucosER@0 for 291 with 3592 remaining (b = 0.85)
1408.48/1408.70	c INFO: running glucosER@0 for 291 with 3591 remaining (b = 0.78)
1408.48/1408.76	c INFO: running cryptominisat-2.9.0@0 for 97 with 3591 remaining (b = 0.44)
1408.58/1408.82	c INFO: running precosat-570@0 for 194 with 3591 remaining (b = 0.46)
2208.17/1508.84	c INFO: running lingeling-276@0 for 291 with 3491 remaining (b = 0.40)
2208.17/1508.88	c INFO: running precosat-570@0 for 97 with 3491 remaining (b = 0.38)
2208.94/1508.94	c INFO: running glucosER@0 for 291 with 3491 remaining (b = 0.65)
2232.04/1511.84	c INFO: running lingeling-276@0 for 97 with 3488 remaining (b = 0.31)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380725-1305490323/watcher-3380725-1305490323 -o /tmp/evaluation-result-3380725-1305490323/solver-3380725-1305490323 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3380725-1305490323.cnf -seed 928338379 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.02 7.83 7.93 2/363 18010
/proc/meminfo: memFree=24516176/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=15772 CPUtime=0 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 915 0 0 0 0 0 0 0 22 0 1 0 641448961 16150528 795 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726448263 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/18010/statm: 3943 799 349 364 0 430 0

[startup+0.035577 s]
/proc/loadavg: 7.02 7.83 7.93 2/363 18010
/proc/meminfo: memFree=24516176/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=16536 CPUtime=0.01 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 1189 0 0 0 1 0 0 0 22 0 1 0 641448961 16932864 1050 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726101645 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/18010/statm: 4133 1049 417 364 0 620 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16536

[startup+0.100566 s]
/proc/loadavg: 7.02 7.83 7.93 2/363 18010
/proc/meminfo: memFree=24516176/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=85616 CPUtime=0.06 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 2627 0 0 0 5 1 0 0 18 0 1 0 641448961 87670784 2347 33554432000 4194304 5683644 140733423440704 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/18010/statm: 21404 2347 713 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85616

[startup+0.300539 s]
/proc/loadavg: 7.02 7.83 7.93 2/363 18010
/proc/meminfo: memFree=24516176/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=135744 CPUtime=0.19 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 5964 934 1 0 14 5 0 0 18 0 1 0 641448961 139001856 4149 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726401029 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/18010/statm: 33936 4149 1032 364 0 3122 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135744

[startup+0.700449 s]
/proc/loadavg: 7.02 7.83 7.93 2/363 18010
/proc/meminfo: memFree=24516176/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=594664 CPUtime=0.44 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 15676 934 1 0 30 14 0 0 17 0 1 0 641448961 608935936 13355 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726404864 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/18010/statm: 148666 13378 1758 364 0 84590 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 594664

[startup+1.5003 s]
/proc/loadavg: 7.02 7.83 7.93 2/364 18015
/proc/meminfo: memFree=24170208/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=634696 CPUtime=1.23 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 97981 934 1 0 93 30 0 0 18 0 1 0 641448961 649928704 95660 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726091472 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18010/statm: 158674 95660 1761 364 0 94598 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 634696

[startup+3.10099 s]
/proc/loadavg: 7.02 7.83 7.93 2/364 18015
/proc/meminfo: memFree=24109944/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=726956 CPUtime=2.84 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 120261 934 1 0 251 33 0 0 21 0 1 0 641448961 744402944 117940 33554432000 4194304 5683644 140733423440704 18446744073709551615 4951589 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18010/statm: 181739 117940 1761 364 0 117663 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 726956

[startup+6.30039 s]
/proc/loadavg: 6.54 7.72 7.89 2/364 18015
/proc/meminfo: memFree=23927204/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=905636 CPUtime=6.04 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 164589 934 1 0 564 40 0 0 25 0 1 0 641448961 927371264 162268 33554432000 4194304 5683644 140733423440704 18446744073709551615 4539178 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18010/statm: 226409 162268 1761 364 0 162333 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 905636

[startup+12.7002 s]
/proc/loadavg: 6.10 7.61 7.85 2/364 18015
/proc/meminfo: memFree=23562908/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=1274604 CPUtime=12.43 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 252865 934 1 0 1192 51 0 0 25 0 1 0 641448961 1305194496 250544 33554432000 4194304 5683644 140733423440704 18446744073709551615 4539738 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18010/statm: 318651 250544 1761 364 0 254575 0
Current children cumulated CPU time (s) 12.43
Current children cumulated vsize (KiB) 1274604

[startup+25.5008 s]
/proc/loadavg: 4.97 7.28 7.74 2/364 18016
/proc/meminfo: memFree=22829992/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2004036 CPUtime=25.23 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 430400 934 1 0 2447 76 0 0 25 0 1 0 641448961 2052132864 428079 33554432000 4194304 5683644 140733423440704 18446744073709551615 47280953328649 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18010/statm: 501009 428079 1761 364 0 436933 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 2004036

[startup+51.1009 s]
/proc/loadavg: 3.61 6.78 7.56 2/364 18016
/proc/meminfo: memFree=22140616/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2306988 CPUtime=50.84 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 800861 934 1 0 4952 132 0 0 25 0 1 0 641448961 2362355712 513670 33554432000 4194304 5683644 140733423440704 18446744073709551615 4438536 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 576747 513670 1764 364 0 512671 0
Current children cumulated CPU time (s) 50.84
Current children cumulated vsize (KiB) 2306988

[startup+102.313 s]
/proc/loadavg: 2.04 5.80 7.18 2/364 18018
/proc/meminfo: memFree=21852424/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2921836 CPUtime=102.05 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 2249771 934 1 0 9900 305 0 0 25 0 1 0 641448961 2991960064 667844 33554432000 4194304 5683644 140733423440704 18446744073709551615 47280782627322 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 730459 667844 1826 364 0 666383 0
Current children cumulated CPU time (s) 102.05
Current children cumulated vsize (KiB) 2921836

[startup+162.301 s]
/proc/loadavg: 1.41 4.99 6.83 2/364 18019
/proc/meminfo: memFree=21852512/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2921836 CPUtime=162.04 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 2249771 934 1 0 15899 305 0 0 25 0 1 0 641448961 2991960064 667844 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726063611 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 730459 667844 1826 364 0 666383 0
Current children cumulated CPU time (s) 162.04
Current children cumulated vsize (KiB) 2921836

[startup+222.301 s]
/proc/loadavg: 1.17 4.22 6.43 2/364 18021
/proc/meminfo: memFree=21852480/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2921836 CPUtime=222.04 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 2249771 934 1 0 21899 305 0 0 25 0 1 0 641448961 2991960064 667844 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726064549 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 730459 667844 1826 364 0 666383 0
Current children cumulated CPU time (s) 222.04
Current children cumulated vsize (KiB) 2921836

[startup+282.3 s]
/proc/loadavg: 1.07 3.68 6.12 2/364 18023
/proc/meminfo: memFree=21852324/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2921836 CPUtime=282.04 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 2249771 934 1 0 27899 305 0 0 25 0 1 0 641448961 2991960064 667844 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726063856 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 730459 667844 1826 364 0 666383 0
Current children cumulated CPU time (s) 282.04
Current children cumulated vsize (KiB) 2921836

[startup+342.301 s]
/proc/loadavg: 1.02 3.19 5.79 2/364 18024
/proc/meminfo: memFree=21838652/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2935728 CPUtime=342.05 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 2253245 934 1 0 33899 306 0 0 25 0 1 0 641448961 3006185472 671318 33554432000 4194304 5683644 140733423440704 18446744073709551615 47280785346082 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 733932 671318 1827 364 0 669856 0
Current children cumulated CPU time (s) 342.05
Current children cumulated vsize (KiB) 2935728

[startup+402.301 s]
/proc/loadavg: 1.01 2.79 5.49 2/364 18026
/proc/meminfo: memFree=21838612/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2935728 CPUtime=402.05 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 2253245 934 1 0 39899 306 0 0 25 0 1 0 641448961 3006185472 671318 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726065749 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 733932 671318 1827 364 0 669856 0
Current children cumulated CPU time (s) 402.05
Current children cumulated vsize (KiB) 2935728

[startup+462.3 s]
/proc/loadavg: 1.00 2.46 5.21 2/364 18027
/proc/meminfo: memFree=21485060/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=3277500 CPUtime=462.06 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 2491444 934 1 0 45872 334 0 0 25 0 1 0 641448961 3356160000 738631 33554432000 4194304 5683644 140733423440704 18446744073709551615 47280782890618 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 819375 738633 1829 364 0 755299 0
Current children cumulated CPU time (s) 462.06
Current children cumulated vsize (KiB) 3277500

[startup+522.301 s]
/proc/loadavg: 1.00 2.19 4.94 2/364 18029
/proc/meminfo: memFree=21838288/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2935728 CPUtime=522.05 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 3193124 934 1 0 51786 419 0 0 25 0 1 0 641448961 3006185472 671324 33554432000 4194304 5683644 140733423440704 18446744073709551615 47280782477452 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 733932 671324 1833 364 0 669856 0
Current children cumulated CPU time (s) 522.05
Current children cumulated vsize (KiB) 2935728

[startup+582.301 s]
/proc/loadavg: 1.00 1.97 4.69 2/364 18031
/proc/meminfo: memFree=21838504/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=2935728 CPUtime=582.06 cores=0-7
/proc/18010/stat : 18010 (python) R 18008 18010 17872 0 -1 4202496 3193124 934 1 0 57787 419 0 0 25 0 1 0 641448961 3006185472 671324 33554432000 4194304 5683644 140733423440704 18446744073709551615 47280782477452 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/18010/statm: 733932 671324 1833 364 0 669856 0
Current children cumulated CPU time (s) 582.06
Current children cumulated vsize (KiB) 2935728

[startup+642.3 s]

################
# More data... #
################

[pid=18088] ppid=18086 vsize=1032924 CPUtime=72.16 cores=0-7
/proc/18088/stat : 18088 (glucoser_static) R 18086 18088 18088 0 -1 4202496 239550 0 0 0 7170 46 0 0 25 0 1 0 641599859 1057714176 238894 33554432000 134512640 134580299 4289491936 18446744073709551615 134543193 0 0 16781312 8388611 0 0 0 17 2 0 0 0
/proc/18088/statm: 258231 238894 242 17 0 257559 0
[pid=18090] ppid=18010 vsize=1778172 CPUtime=0.21 cores=0-7
/proc/18090/stat : 18090 (python) S 18010 18010 17872 0 -1 4202560 954 0 0 0 10 11 0 0 18 0 1 0 641600145 1820848128 341076 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 7436867951858254084 0 0 17 0 0 0 0
/proc/18090/statm: 444543 341076 370 364 0 380434 0
[pid=18092] ppid=18090 vsize=749512 CPUtime=69.3 cores=0-7
/proc/18092/stat : 18092 (lingeling) R 18090 18092 18092 0 -1 4202496 291539 0 0 0 6882 48 0 0 25 0 1 0 641600149 767500288 186546 33554432000 4194304 4352236 140734767967776 18446744073709551615 4208366 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/18092/statm: 187378 186546 127 39 0 186458 0
[pid=18010/tid=18058] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18058/stat : 18058 (python) S 18008 18010 17872 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 11 0 641589809 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18061] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18061/stat : 18061 (python) S 18008 18010 17872 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 11 0 641589814 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18064] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18064/stat : 18064 (python) S 18008 18010 17872 0 -1 4202560 24 934 0 0 0 0 0 0 19 0 11 0 641589819 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 6 0 0 0
[pid=18010/tid=18067] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18067/stat : 18067 (python) S 18008 18010 17872 0 -1 4202560 19 934 0 0 0 0 0 0 20 0 11 0 641589825 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 5 0 0 0
[pid=18010/tid=18070] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18070/stat : 18070 (python) S 18008 18010 17872 0 -1 4202560 22 934 0 0 0 0 0 0 19 0 11 0 641589830 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18073] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18073/stat : 18073 (python) S 18008 18010 17872 0 -1 4202560 29 934 0 0 0 0 0 0 21 0 11 0 641589835 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 1 0 0 0
[pid=18010/tid=18076] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18076/stat : 18076 (python) S 18008 18010 17872 0 -1 4202560 36 934 0 0 0 0 0 0 23 0 11 0 641589841 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18079] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18079/stat : 18079 (python) S 18008 18010 17872 0 -1 4202560 28 934 0 0 0 0 0 0 25 0 11 0 641589847 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18087] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18087/stat : 18087 (python) S 18008 18010 17872 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 11 0 641599859 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18091] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18091/stat : 18091 (python) S 18008 18010 17872 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 11 0 641600149 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2788.99
Current children cumulated vsize (KiB) 31870200

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

############
# WARNING:
# current cumulated CPU time (1408.86 s) is less than in the last sample (2788.99 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (1380.13 s) to the 'lost time'.

[startup+1581.6 s]
/proc/loadavg: 7.74 4.14 3.44 9/398 18094
/proc/meminfo: memFree=11044716/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=1788416 CPUtime=1408.77 cores=0-7
/proc/18010/stat : 18010 (python) S 18008 18010 17872 0 -1 4202496 3202467 934 1 0 140415 462 0 0 19 0 11 0 641448961 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/18010/statm: 447104 342604 1894 364 0 382995 0
[pid=18057] ppid=18010 vsize=1630576 CPUtime=0.52 cores=0-7
/proc/18057/stat : 18057 (python) S 18010 18010 17872 0 -1 4202560 1200 0 0 0 23 29 0 0 18 0 2 0 641589806 1669709824 341088 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18057/statm: 407644 341088 415 364 0 343562 0
[pid=18059] ppid=18057 vsize=730908 CPUtime=173.04 cores=0-7
/proc/18059/stat : 18059 (lingeling) R 18057 18059 18059 0 -1 4202496 301071 0 0 0 17252 52 0 0 25 0 1 0 641589809 748449792 181897 33554432000 4194304 4352236 140734478769392 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/18059/statm: 182727 181897 129 39 0 181807 0
[pid=18057/tid=18083] ppid=18010 vsize=1630576 CPUtime=0 cores=0-7
/proc/18057/task/18083/stat : 18083 (python) S 18010 18010 17872 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 641599844 1669709824 341088 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 514 18446604447336174016 0 0 -1 1 0 0 0
[pid=18060] ppid=18010 vsize=1630588 CPUtime=0.52 cores=0-7
/proc/18060/stat : 18060 (python) S 18010 18010 17872 0 -1 4202560 1144 0 0 0 27 25 0 0 18 0 2 0 641589811 1669722112 341072 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18060/statm: 407647 341072 399 364 0 343562 0
[pid=18062] ppid=18060 vsize=1960336 CPUtime=172.8 cores=0-7
/proc/18062/stat : 18062 (precosat) R 18060 18062 18062 0 -1 4202496 502606 0 0 0 17202 78 0 0 25 0 1 0 641589814 2007384064 470945 33554432000 4194304 4890832 140733589403056 18446744073709551615 4246738 0 0 16781312 17442 0 0 0 17 6 0 0 0
/proc/18062/statm: 490084 470945 80 171 0 489911 0
[pid=18060/tid=18084] ppid=18010 vsize=1630588 CPUtime=0 cores=0-7
/proc/18060/task/18084/stat : 18084 (python) S 18010 18010 17872 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 641599847 1669722112 341072 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 514 18446604440860968064 0 0 -1 4 0 0 0
[pid=18063] ppid=18010 vsize=1706380 CPUtime=0.33 cores=0-7
/proc/18063/stat : 18063 (python) S 18010 18010 17872 0 -1 4202560 1102 0 0 0 15 18 0 0 19 0 2 0 641589816 1747333120 341078 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18063/statm: 426595 341078 399 364 0 362507 0
[pid=18065] ppid=18063 vsize=753844 CPUtime=100.05 cores=0-7
/proc/18065/stat : 18065 (lingeling) T 18063 18065 18065 0 -1 4202496 292625 0 0 0 9956 49 0 0 25 0 1 0 641589820 771936256 187630 33554432000 4194304 4352236 140737187598784 18446744073709551615 4331541 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/18065/statm: 188461 187630 129 39 0 187541 0
[pid=18063/tid=18085] ppid=18010 vsize=1706380 CPUtime=0 cores=0-7
/proc/18063/task/18085/stat : 18085 (python) S 18010 18010 17872 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 641599854 1747333120 341078 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 514 18446604440278902912 0 0 -1 6 0 0 0
[pid=18066] ppid=18010 vsize=1651100 CPUtime=0.53 cores=0-7
/proc/18066/stat : 18066 (python) S 18010 18010 17872 0 -1 4202560 980 0 0 0 25 28 0 0 18 0 1 0 641589821 1690726400 341050 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 7436867951858254081 0 0 17 7 0 0 0
/proc/18066/statm: 412775 341050 370 364 0 348684 0
[pid=18068] ppid=18066 vsize=992212 CPUtime=172.93 cores=0-7
/proc/18068/stat : 18068 (lingeling) R 18066 18068 18068 0 -1 4202496 377099 0 0 0 17228 65 0 0 25 0 1 0 641589825 1016025088 247223 33554432000 4194304 4352236 140736907217456 18446744073709551615 4207602 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/18068/statm: 248053 247223 129 39 0 247133 0
[pid=18069] ppid=18010 vsize=1726892 CPUtime=0.53 cores=0-7
/proc/18069/stat : 18069 (python) S 18010 18010 17872 0 -1 4202560 985 0 0 0 25 28 0 0 18 0 1 0 641589826 1768337408 341056 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 7436867951858254083 0 0 17 7 0 0 0
/proc/18069/statm: 431723 341056 370 364 0 367629 0
[pid=18071] ppid=18069 vsize=1053172 CPUtime=172.32 cores=0-7
/proc/18071/stat : 18071 (glucoser_static) R 18069 18071 18071 0 -1 4202496 244603 0 0 0 17185 47 0 0 25 0 1 0 641589830 1078448128 243947 33554432000 134512640 134580299 4288817408 18446744073709551615 134543199 0 0 16781312 8388611 0 0 0 17 3 0 0 0
/proc/18071/statm: 263293 243947 243 17 0 262621 0
[pid=18072] ppid=18010 vsize=1737148 CPUtime=0.5 cores=0-7
/proc/18072/stat : 18072 (python) S 18010 18010 17872 0 -1 4202560 985 0 0 0 26 24 0 0 18 0 1 0 641589832 1778839552 341060 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 7436867951858254083 0 0 17 2 0 0 0
/proc/18072/statm: 434287 341060 370 364 0 370190 0
[pid=18074] ppid=18072 vsize=1053172 CPUtime=168.85 cores=0-7
/proc/18074/stat : 18074 (glucoser_static) R 18072 18074 18074 0 -1 4202496 244602 0 0 0 16839 46 0 0 25 0 1 0 641589836 1078448128 243945 33554432000 134512640 134580299 4286762928 18446744073709551615 134553306 0 0 16781312 8388611 0 0 0 17 7 0 0 0
/proc/18074/statm: 263293 243945 243 17 0 262621 0
[pid=18075] ppid=18010 vsize=1747404 CPUtime=0.33 cores=0-7
/proc/18075/stat : 18075 (python) S 18010 18010 17872 0 -1 4202560 1125 0 0 0 16 17 0 0 16 0 2 0 641589837 1789341696 341094 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18075/statm: 436851 341094 399 364 0 372751 0
[pid=18077] ppid=18075 vsize=2656276 CPUtime=102.69 cores=0-7
/proc/18077/stat : 18077 (cryptominisat-2) T 18075 18077 18077 0 -1 4202496 567804 0 0 0 10193 76 0 0 25 0 1 0 641589841 2720026624 535683 33554432000 4194304 4677096 140734255512368 18446744073709551615 4319643 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/18077/statm: 664069 535683 383 118 0 659028 0
[pid=18075/tid=18089] ppid=18010 vsize=1747404 CPUtime=0 cores=0-7
/proc/18075/task/18089/stat : 18089 (python) S 18010 18010 17872 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 641600143 1789341696 341094 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 514 18446604452348099520 0 0 -1 1 0 0 0
[pid=18078] ppid=18010 vsize=1757660 CPUtime=0.52 cores=0-7
/proc/18078/stat : 18078 (python) S 18010 18010 17872 0 -1 4202560 1056 0 0 0 25 27 0 0 18 0 1 0 641589843 1799843840 341074 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 7436867951858254084 0 0 17 6 0 0 0
/proc/18078/statm: 439415 341074 376 364 0 375312 0
[pid=18080] ppid=18078 vsize=1965592 CPUtime=171.86 cores=0-7
/proc/18080/stat : 18080 (precosat) R 18078 18080 18080 0 -1 4202496 504026 0 0 0 17100 86 0 0 25 0 1 0 641589847 2012766208 472049 33554432000 4194304 4890832 140737234964096 18446744073709551615 4293232 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/18080/statm: 491398 472049 80 171 0 491225 0
[pid=18086] ppid=18010 vsize=1767916 CPUtime=0.23 cores=0-7
/proc/18086/stat : 18086 (python) S 18010 18010 17872 0 -1 4202560 982 0 0 0 9 14 0 0 18 0 1 0 641599855 1810345984 341078 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 7436867951858254081 0 0 17 2 0 0 0
/proc/18086/statm: 441979 341078 376 364 0 377873 0
[pid=18088] ppid=18086 vsize=1032924 CPUtime=72.16 cores=0-7
/proc/18088/stat : 18088 (glucoser_static) R 18086 18088 18088 0 -1 4202496 239550 0 0 0 7170 46 0 0 25 0 1 0 641599859 1057714176 238894 33554432000 134512640 134580299 4289491936 18446744073709551615 134543193 0 0 16781312 8388611 0 0 0 17 2 0 0 0
/proc/18088/statm: 258231 238894 242 17 0 257559 0
[pid=18090] ppid=18010 vsize=1778172 CPUtime=0.21 cores=0-7
/proc/18090/stat : 18090 (python) S 18010 18010 17872 0 -1 4202560 954 0 0 0 10 11 0 0 18 0 1 0 641600145 1820848128 341076 33554432000 4194304 5683644 140733423440704 18446744073709551615 264726425158 0 0 16781312 514 7436867951858254084 0 0 17 0 0 0 0
/proc/18090/statm: 444543 341076 370 364 0 380434 0
[pid=18092] ppid=18090 vsize=749512 CPUtime=69.3 cores=0-7
/proc/18092/stat : 18092 (lingeling) R 18090 18092 18092 0 -1 4202496 291539 0 0 0 6882 48 0 0 25 0 1 0 641600149 767500288 186546 33554432000 4194304 4352236 140734767967776 18446744073709551615 4208366 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/18092/statm: 187378 186546 127 39 0 186458 0
[pid=18010/tid=18058] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18058/stat : 18058 (python) S 18008 18010 17872 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 11 0 641589809 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18061] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18061/stat : 18061 (python) S 18008 18010 17872 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 11 0 641589814 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18064] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18064/stat : 18064 (python) S 18008 18010 17872 0 -1 4202560 24 934 0 0 0 0 0 0 19 0 11 0 641589819 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 6 0 0 0
[pid=18010/tid=18067] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18067/stat : 18067 (python) S 18008 18010 17872 0 -1 4202560 19 934 0 0 0 0 0 0 20 0 11 0 641589825 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 5 0 0 0
[pid=18010/tid=18070] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18070/stat : 18070 (python) S 18008 18010 17872 0 -1 4202560 22 934 0 0 0 0 0 0 19 0 11 0 641589830 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18073] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18073/stat : 18073 (python) S 18008 18010 17872 0 -1 4202560 29 934 0 0 0 0 0 0 21 0 11 0 641589835 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 1 0 0 0
[pid=18010/tid=18076] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18076/stat : 18076 (python) S 18008 18010 17872 0 -1 4202560 36 934 0 0 0 0 0 0 23 0 11 0 641589841 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18079] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18079/stat : 18079 (python) S 18008 18010 17872 0 -1 4202560 28 934 0 0 0 0 0 0 25 0 11 0 641589847 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18087] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18087/stat : 18087 (python) S 18008 18010 17872 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 11 0 641599859 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 0 0 0 0
[pid=18010/tid=18091] ppid=18008 vsize=1788416 CPUtime=0 cores=0-7
/proc/18010/task/18091/stat : 18091 (python) S 18008 18010 17872 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 11 0 641600149 1831337984 342604 33554432000 4194304 5683644 140733423440704 18446744073709551615 264738228657 0 0 16781312 2 18446604440860968960 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2788.99
Current children cumulated vsize (KiB) 31870200

[startup+1581.83 s]
/proc/loadavg: 7.74 4.14 3.44 2/378 18095
/proc/meminfo: memFree=21494384/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=0 CPUtime=1408.86 cores=0-7
/proc/18010/stat : 18010 (python) Z 18008 18010 17872 0 -1 4203548 3202475 934 1 0 140415 471 0 0 18 0 1 0 641448961 0 0 33554432000 0 0 0 0 0 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18010/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1408.86
Current children cumulated vsize (KiB) 0
#
############


Solver just ended. Dumping a history of the last processes samples

[startup+1581.83 s]
/proc/loadavg: 7.74 4.14 3.44 2/378 18095
/proc/meminfo: memFree=21494384/32951124 swapFree=63083172/67111528
[pid=18010] ppid=18008 vsize=0 CPUtime=1408.86 cores=0-7
/proc/18010/stat : 18010 (python) Z 18008 18010 17872 0 -1 4203548 3202475 934 1 0 140415 471 0 0 18 0 1 0 641448961 0 0 33554432000 0 0 0 0 0 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18010/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1408.86
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 1380.13
#  lost CPU user time (s): 1372.08
#  lost CPU system time (s): 8.05

Real time (s): 1581.84
CPU time (s): 2789.01
CPU user time (s): 2776.24
CPU system time (s): 12.7703
CPU usage (%): 176.314
Max. virtual memory (cumulated for all children) (KiB): 31870200

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1404.16
system time used= 4.72028
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3203409
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2972
involuntary context switches= 3564

runsolver used 5.2822 second user time and 13.254 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-15 22:12:13
IDJOB=3380725
IDBENCH=71686
IDSOLVER=1864
FILE ID=node141/3380725-1305490323
RUNJOBID= node141-1305487730-17886
PBS_JOBID= 13325396
Free space on /tmp= 73052 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT_RACE06/velev-npe-1.0-9dlx-b71.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380725-1305490323/watcher-3380725-1305490323 -o /tmp/evaluation-result-3380725-1305490323/solver-3380725-1305490323 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3380725-1305490323.cnf -seed 928338379 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 75d91f0ba4398ccb5b452707c0e7fa27
RANDOM SEED=928338379

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24516464 kB
Buffers:        277592 kB
Cached:        5723948 kB
SwapCached:      15728 kB
Active:        2761932 kB
Inactive:      5410872 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24516464 kB
SwapTotal:    67111528 kB
SwapFree:     63083172 kB
Dirty:          348636 kB
Writeback:           0 kB
AnonPages:     2162648 kB
Mapped:          12872 kB
Slab:           158100 kB
PageTables:      38152 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 86433060 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73020 MiB
End job on node141 at 2011-05-15 22:38:37