Trace number 4103757

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 198.931 199.031

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-stocfor2.opb
MD5SUMaaead0b856e770577601eb0cbaa220bd
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark1.91271
Has Objective FunctionYES
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables60930
Total number of constraints2157
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2157
Minimum length of a constraint30
Maximum length of a constraint450
Number of terms in the objective function 31770
Biggest coefficient in the objective function 1855425871872000000
Number of bits for the biggest coefficient in the objective function 61
Sum of the numbers in the objective function 393343428838367800485
Number of bits of the sum of numbers in the objective function 69
Biggest number in a constraint 1855425871872000000
Number of bits of the biggest number in a constraint 61
Biggest sum of numbers in a constraint 393343428838367800485
Number of bits of the biggest sum of numbers69
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T10:36:00+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103757-1466238960.opb"]
0.00/0.01	c use --random-gen="865879578 47644231 2407759477 3110942093 3183901895 358396992 2931368995 2815176028 3093035117 1093011452 2739937578 1883036230 62105548 331296135 3438504192 555715765 3855409231 2690127728 4240092689 2457048792 127760866 3296834677 3897165210 2660749011 3379964526 219075697 3984083793 281004174 340106101 465842648 2573285032 3230056870 2338408002 4031107248 1393634842 3006804550 3333367073 3266391849 4226311874 567880420 4198328933 1980418066 1110908265 3070050033 3625829958 1051149272 84207419 1533502898 808348451 1958179839 846146420 936032886 77512325 3022412533 1926006854 3401173691 2176518504 341259857 2522245226 128600354 1214339126 3944333244 2895093064 1724188012 1416959208 1895837750 3082844837 2111422844 3163476031 2261919529 3741889855 406920485 2749158152 1662546175 3375996705 425759996 1872506318 2005197388 1598424842 803556015 3607023310 3044621758 3060831658 1277733108 2747738385 1859443099 2023425013 543307624 858489940 1415604958 2951006182 1658919526 3266454088 800958806 56819781 3486701102 1830724902 1718268126 1629272552 2775402951 927618463 2095124581 2821712801 745712394 2480088598 3238883965 1109373230 3427822390 984003521 3437013991 2080040962 3422089093 2146789931 918441299 2918771234 2247198345 3553251715 3541483110 2249625197 2382060409 2456019403 3086010396 4056421881 4113042058 3944990677 3736996722 1288221821 1006701831 1189881767 4191551180 745157194 1152207314 1347216295 2622684451 3864156526 1748003343 3668537703 1272667856 161834784 3427026672 2929743715 238611455 4118734359 475463048 3437141783 1545423033 1464682785 345168982 3074372056 1997254633 2257916887 322446643 1002178457 4273021922 2170443437 1442094773 717642676 2045198758 2668749319 847125274 2872426529 467137203 1246799666 260863654 2141550318 3663234003 3011972699 1185705031 212792248 2114064082 3367131835 969467331 4162568158 3859301357 1877349598 1450384516 2782286722 2892931987 195117261 134980971 3162145725 2783667141 473557106 1028200509 3479732592 1548905412 3910101428 4186767335 3270474870 1012618630 2858098827 2867957498 53792816 663846810 2197178182 3657032258 3969832624 3886930480 1662074279 1807683971 931200359 3155984095 1347626059 4139560861 1095287571 2271629272 2098627299 4028051370 3279224254 223032775 194509670 3883234460 3411620539 2274762124 1502716334 2936126790 1119479138 77955509 2080807176 3698686150 2764949457 3251131863 532142684 2738475460 1762997778 1570474266 3748052669 2574940991 888088860 2570867910 2784752446 444593772 946804659 2532449368 2431077858 2794981102 310550943 826941020 2447735865 1383994685 3980659071 670518436 3759909429 3241233560 1995594092 3341166295 1766273161 1599081261 383531230 4025369778 4137663547 1397365955 1757400293 3395242909 999871216 2897253962 255 362436" option to reproduce the execution
0.49/0.56	c #vars 60930
0.49/0.56	c #constraints 2157

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103757-1466238960/watcher-4103757-1466238960 -o /tmp/evaluation-result-4103757-1466238960/solver-4103757-1466238960 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103757-1466238960.opb 

pid=16151
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 2.12 2.09 3/179 16154
/proc/meminfo: memFree=20845300/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=687548 CPUtime=0 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 2556 0 0 0 0 0 0 0 20 0 4 0 25946408 704049152 2917 33554432000 4194304 16246674 140735754762672 140735754762096 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/16154/statm: 172399 2928 441 2943 0 169293 0
[pid=16154/tid=16155] ppid=16151 vsize=704956 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 721874944 2987 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=709052 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 726069248 3001 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=713148 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 730263552 3019 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100176 s]
/proc/loadavg: 2.08 2.12 2.09 3/179 16154
/proc/meminfo: memFree=20845300/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=1304132 CPUtime=0.09 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 31547 0 0 0 5 4 0 0 20 0 4 0 25946408 1335431168 31845 33554432000 4194304 16246674 140735754762672 140735754761984 7364033 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/16154/statm: 326033 31861 799 2943 0 322927 0
[pid=16154/tid=16155] ppid=16151 vsize=1304132 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 1335431168 31872 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=1304132 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 1335431168 31883 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=1304132 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 1335431168 31894 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1304132

[startup+0.200521 s]
/proc/loadavg: 2.08 2.12 2.09 3/179 16154
/proc/meminfo: memFree=20845300/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=1311300 CPUtime=0.18 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 43307 0 0 0 13 5 0 0 20 0 4 0 25946408 1342771200 44116 33554432000 4194304 16246674 140735754762672 140735754761984 13965680 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/16154/statm: 327825 44116 801 2943 0 324719 0
[pid=16154/tid=16155] ppid=16151 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 1342771200 44116 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 1342771200 44116 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 1342771200 44116 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 1311300

[startup+0.300514 s]
/proc/loadavg: 2.08 2.12 2.09 3/179 16154
/proc/meminfo: memFree=20845300/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=1311300 CPUtime=0.28 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 43526 0 0 0 23 5 0 0 20 0 4 0 25946408 1342771200 44335 33554432000 4194304 16246674 140735754762672 140735754761984 14073329 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/16154/statm: 327825 44335 801 2943 0 324719 0
[pid=16154/tid=16155] ppid=16151 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 1342771200 44335 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 1342771200 44335 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 1342771200 44335 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 1311300

[startup+0.700427 s]
/proc/loadavg: 2.08 2.12 2.09 3/179 16154
/proc/meminfo: memFree=20845300/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=1312324 CPUtime=0.69 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 62925 0 0 0 61 8 0 0 20 0 4 0 25946408 1343819776 63734 33554432000 4194304 16246674 140735754762672 140735754744576 12652961 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/16154/statm: 328081 63746 834 2943 0 324975 0
[pid=16154/tid=16155] ppid=16151 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 1343819776 63753 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 1343819776 63759 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 1343819776 63765 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1312324

[startup+1.50042 s]
/proc/loadavg: 2.08 2.12 2.09 3/183 16158
/proc/meminfo: memFree=20182708/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=1312324 CPUtime=1.49 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 265939 0 0 0 115 34 0 0 20 0 4 0 25946408 1343819776 266749 33554432000 4194304 16246674 140735754762672 140735754744576 6958849 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/16154/statm: 328081 266760 834 2943 0 324975 0
[pid=16154/tid=16155] ppid=16151 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 1343819776 266768 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 1343819776 266776 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 1343819776 266782 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1312324

[startup+3.10041 s]
/proc/loadavg: 2.08 2.12 2.09 3/182 16158
/proc/meminfo: memFree=19553224/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=1528388 CPUtime=3.09 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 322715 0 0 0 268 41 0 0 20 0 4 0 25946408 1565069312 323524 33554432000 4194304 16246674 140735754762672 140735754744576 13880742 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/16154/statm: 382097 323524 835 2943 0 378991 0
[pid=16154/tid=16155] ppid=16151 vsize=1528388 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 1565069312 323524 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=1528388 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 1565069312 323524 33554432000 4194304 16246674 140735754762672 139756741565456 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=1528388 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 1565069312 323524 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1528388

[startup+6.30043 s]
/proc/loadavg: 2.07 2.12 2.09 3/182 16158
/proc/meminfo: memFree=19552884/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=1528388 CPUtime=6.29 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 322718 0 0 0 588 41 0 0 20 0 4 0 25946408 1565069312 323527 33554432000 4194304 16246674 140735754762672 140735754760512 4206597 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 382097 323527 835 2943 0 378991 0
[pid=16154/tid=16155] ppid=16151 vsize=1528388 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 1565069312 323527 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=1528388 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 1565069312 323527 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=1528388 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 1565069312 323527 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1528388

[startup+12.7004 s]
/proc/loadavg: 2.07 2.11 2.09 3/183 16159
/proc/meminfo: memFree=16454520/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=2734660 CPUtime=12.69 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 624288 0 0 0 1185 84 0 0 20 0 4 0 25946408 2800291840 625097 33554432000 4194304 16246674 140735754762672 140735754760512 4220489 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 683665 625097 836 2943 0 680559 0
[pid=16154/tid=16155] ppid=16151 vsize=2734660 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 2800291840 625097 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=2734660 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 2800291840 625097 33554432000 4194304 16246674 140735754762672 139756741565456 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=2734660 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 2800291840 625097 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 2734660

[startup+25.5005 s]
/proc/loadavg: 2.12 2.12 2.09 3/183 16159
/proc/meminfo: memFree=13182940/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=4949572 CPUtime=25.48 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 1178016 0 0 0 2388 160 0 0 20 0 4 0 25946408 5068361728 1178825 33554432000 4194304 16246674 140735754762672 140735754761768 4220543 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 1237393 1178825 836 2943 0 1234287 0
[pid=16154/tid=16155] ppid=16151 vsize=4949572 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 5068361728 1178825 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=4949572 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 5068361728 1178825 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=4949572 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 5068361728 1178825 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 4949572

[startup+51.1005 s]
/proc/loadavg: 2.08 2.11 2.09 3/183 16159
/proc/meminfo: memFree=8873368/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=9251396 CPUtime=51.07 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 2253474 0 0 0 4808 299 0 0 20 0 4 0 25946408 9473429504 2254283 33554432000 4194304 16246674 140735754762672 140735754761848 15015658 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 2312849 2254283 836 2943 0 2309743 0
[pid=16154/tid=16155] ppid=16151 vsize=9251396 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 9473429504 2254283 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=9251396 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 9473429504 2254283 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=9251396 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 9473429504 2254283 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 9251396

[startup+102.3 s]
/proc/loadavg: 2.07 2.11 2.09 4/183 16160
/proc/meminfo: memFree=2971464/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=13300292 CPUtime=102.26 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 3265704 0 0 0 9791 435 0 0 20 0 4 0 25946408 13619499008 3266513 33554432000 4194304 16246674 140735754762672 140735754761848 15015658 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 3325073 3266513 841 2943 0 3321967 0
[pid=16154/tid=16155] ppid=16151 vsize=13300292 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 13619499008 3266513 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=13300292 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 13619499008 3266513 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=13300292 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 13619499008 3266513 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 13300292

[startup+162.3 s]
/proc/loadavg: 2.06 2.10 2.09 3/183 16210
/proc/meminfo: memFree=11923948/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=15367748 CPUtime=162.22 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 3725119 0 0 0 15719 503 0 0 20 0 4 0 25946408 15736573952 3783160 33554432000 4194304 16246674 140735754762672 140735754760640 13899629 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 3841937 3783160 841 2943 0 3838831 0
[pid=16154/tid=16155] ppid=16151 vsize=15367748 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 15736573952 3783160 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=15367748 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 15736573952 3783160 33554432000 4194304 16246674 140735754762672 139756741565456 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=15367748 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 15736573952 3783160 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 15367748



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+198.2 s]
/proc/loadavg: 2.11 2.10 2.09 3/183 16210
/proc/meminfo: memFree=11612056/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=15876676 CPUtime=198.1 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) R 16151 16154 11324 0 -1 4202496 3852321 0 0 0 19287 523 0 0 20 0 4 0 25946408 16257716224 3910618 33554432000 4194304 16246674 140735754762672 140735754761336 4225154 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 3969169 3910627 841 2943 0 3966063 0
[pid=16154/tid=16155] ppid=16151 vsize=15876676 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) S 16151 16154 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25946408 16257716224 3910632 33554432000 4194304 16246674 140735754762672 139756752055536 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=16154/tid=16156] ppid=16151 vsize=15876676 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16156/stat : 16156 (toysat) S 16151 16154 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946408 16257716224 3910638 33554432000 4194304 16246674 140735754762672 139756741565680 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=16154/tid=16157] ppid=16151 vsize=15876676 CPUtime=0 cores=1,3,5,7
/proc/16154/task/16157/stat : 16157 (toysat) S 16151 16154 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946408 16257716224 3910643 33554432000 4194304 16246674 140735754762672 139756625194160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 198.1
Current children cumulated vsize (KiB) 15876676

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 16154 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+198.4 s]
/proc/loadavg: 2.11 2.10 2.09 3/183 16210
/proc/meminfo: memFree=11612056/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=0 CPUtime=198.29 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) Z 16151 16154 11324 0 -1 4203532 3852823 0 0 0 19287 542 0 0 20 0 2 0 25946408 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 0 0 0 0 0 0 0
[pid=16154/tid=16155] ppid=16151 vsize=0 CPUtime=0.18 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) R 16151 16154 11324 0 -1 4203588 10 0 0 0 0 18 0 0 20 0 2 0 25946408 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 198.29
Current children cumulated vsize (KiB) 0

[startup+198.8 s]
/proc/loadavg: 2.11 2.10 2.09 3/183 16210
/proc/meminfo: memFree=11612056/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=0 CPUtime=198.69 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) Z 16151 16154 11324 0 -1 4203532 3852823 0 0 0 19287 582 0 0 20 0 2 0 25946408 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 0 0 0 0 0 0 0
[pid=16154/tid=16155] ppid=16151 vsize=0 CPUtime=0.58 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) R 16151 16154 11324 0 -1 4203588 10 0 0 0 0 58 0 0 20 0 2 0 25946408 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 198.69
Current children cumulated vsize (KiB) 0

[startup+199 s]
/proc/loadavg: 2.11 2.10 2.09 3/183 16210
/proc/meminfo: memFree=11612056/32872528 swapFree=249320/249320
[pid=16154] ppid=16151 vsize=0 CPUtime=198.89 cores=1,3,5,7
/proc/16154/stat : 16154 (toysat) Z 16151 16154 11324 0 -1 4203532 3852823 0 0 0 19287 602 0 0 20 0 2 0 25946408 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16154/statm: 0 0 0 0 0 0 0
[pid=16154/tid=16155] ppid=16151 vsize=0 CPUtime=0.78 cores=1,3,5,7
/proc/16154/task/16155/stat : 16155 (toysat) R 16151 16154 11324 0 -1 4203588 10 0 0 0 0 78 0 0 20 0 2 0 25946408 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 198.89
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 199.031
CPU time (s): 198.931
CPU user time (s): 192.879
CPU system time (s): 6.05208
CPU usage (%): 99.9494
Max. virtual memory (cumulated for all children) (KiB): 15876676

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 192.879
system time used= 6.05208
maximum resident set size= 15644480
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3852823
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 81
involuntary context switches= 471

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.580911 second user time and 0.85087 second system time

The end

Launcher Data 

Begin job on node103 at 2016-06-18 10:36:00
IDJOB=4103757
IDBENCH=2453
IDSOLVER=2542
FILE ID=node103/4103757-1466238960
RUNJOBID= node103-1466206104-11341
PBS_JOBID= 19918169
Free space on /tmp= 71712 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-stocfor2.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103757-1466238960/watcher-4103757-1466238960 -o /tmp/evaluation-result-4103757-1466238960/solver-4103757-1466238960 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103757-1466238960.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= aaead0b856e770577601eb0cbaa220bd
RANDOM SEED=639821767

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        20845944 kB
Buffers:          129664 kB
Cached:           145420 kB
SwapCached:         2188 kB
Active:         10834336 kB
Inactive:         183104 kB
Active(anon):   10740808 kB
Inactive(anon):     3672 kB
Active(file):      93528 kB
Inactive(file):   179432 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             20600 kB
Writeback:             0 kB
AnonPages:      10990640 kB
Mapped:            10420 kB
Shmem:                 0 kB
Slab:             603088 kB
SReclaimable:      46916 kB
SUnreclaim:       556172 kB
KernelStack:        1448 kB
PageTables:        25508 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:   11133540 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:      4096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71696 MiB
End job on node103 at 2016-06-18 10:39:19