Trace number 4103705

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 165.117 165.149

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-scfxm2.opb
MD5SUM8867980cf2a1dbd0adf6037d5e517a28
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark1.3348
Has Objective FunctionYES
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables27420
Total number of constraints654
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints654
Minimum length of a constraint30
Maximum length of a constraint1710
Number of terms in the objective function 1380
Biggest coefficient in the objective function 5368709120
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 281320357626
Number of bits of the sum of numbers in the objective function 39
Biggest number in a constraint 53687091200000
Number of bits of the biggest number in a constraint 46
Biggest sum of numbers in a constraint 326830904793855
Number of bits of the biggest sum of numbers49
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T10:33:06+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103705-1466238786.opb"]
0.00/0.01	c use --random-gen="224884106 1294854290 1993951903 87264020 2788512683 1343257829 27625274 2540961056 1332140044 1736982508 968864977 2989563997 4103527887 704953243 1957353945 3862774907 1067330135 3845463970 983553230 3924347568 3446753948 54939916 2245295961 829726972 3468940184 3824057358 328565500 3515855294 2035474168 141398969 2601382197 2931344729 2687105960 1798248945 68313492 708822213 2213469738 3890825285 2118206250 708602440 3219595467 3531352904 2638950268 1976033677 386619513 668278882 2854977973 2818865399 2884820961 504423221 226041690 1839814437 3029233922 3872440526 3308751746 1750432156 477926895 2488153845 1159354536 3786359615 2411956657 7828146 2337815594 561660857 1689728943 436340886 1076243508 2455410482 1416126642 671417767 736164049 1556994603 898336348 2105035443 4121032727 868049612 3467526000 2678552203 3227923693 3576112626 2919074742 4010167238 1253058371 4231513899 4222723788 1101139006 4206676326 2042154953 3361305358 545524486 3995615357 3697487321 3466608774 523438243 2122881858 1127091602 3558465179 3019362710 135537943 2804539915 173480604 757613615 3148679688 2565855574 987978042 813326840 3985597855 2502897004 2856638950 3712025229 1671252418 3024226970 3990761034 3171033461 2857439319 1958986407 2314540902 136618308 3841614542 4153237461 4125131265 1824774086 87818871 3566692268 3539371193 1900186863 3030626154 214882830 3084956948 141947845 167347739 1159637053 1111304099 3489613947 1631395135 1253872956 1441839050 3232638657 169816106 3898947238 2898711096 2877309557 2844053055 457994331 1883061271 2219236635 3618164715 3077366018 3797029425 1233982818 4159966359 283601163 2495840198 1565914794 1574692968 3525637610 8795329 3114935129 3690984967 1735581744 597080515 1170551152 398385464 2310378903 2584912945 3744632995 168773782 10586347 1672651069 3610103104 1710228201 530827718 3996245237 4110897608 3028927245 3405632382 3914087836 2768732326 2770713018 595439325 1862601574 3138528112 1574966429 2214539967 344885577 752750037 2313047994 3383202342 846543001 1357859118 1250065036 1490085687 1481789106 3388081077 4251952598 3760903530 902895940 1513413611 2137257783 2563026178 227522716 804305345 684570246 1966289347 2169284879 3224367525 677488336 3986498485 4042259877 1352892136 3870510299 2026963984 3372098606 243073879 1992019600 2095489491 1904498643 740418153 2022275619 3151935900 3736174935 1203096609 715855622 2465435795 1279591378 2466241055 2508988884 433915130 103986015 3185421008 3760429021 38201411 2651898974 1863193315 4205369267 1826826219 2600217924 4108548354 2985983723 2073010011 1081885834 3736876223 1376346272 1865305556 3425655721 3661496996 1144314339 571307815 3163139007 1674024815 573532111 287720905 3755835567 724878433 4126416637 1848186631 255 362436" option to reproduce the execution
0.29/0.30	c #vars 27420
0.29/0.30	c #constraints 654

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103705-1466238786/watcher-4103705-1466238786 -o /tmp/evaluation-result-4103705-1466238786/solver-4103705-1466238786 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node123-1466206081-596 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103705-1466238786.opb 

pid=6152
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.35 2.34 2.28 3/179 6155
/proc/meminfo: memFree=28845480/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=696764 CPUtime=0 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 2597 0 0 0 0 0 0 0 20 0 4 0 25925764 713486336 2958 33554432000 4194304 16246674 140735452562912 140735452562336 13880264 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 174959 2966 441 2943 0 171853 0
[pid=6155/tid=6156] ppid=6152 vsize=714172 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 731312128 3026 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=718268 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 735506432 3042 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=723388 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 740749312 3059 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0

[startup+0.100179 s]
/proc/loadavg: 2.35 2.34 2.28 3/179 6155
/proc/meminfo: memFree=28845480/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=1303108 CPUtime=0.09 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 29019 0 0 0 5 4 0 0 20 0 4 0 25925764 1334382592 29317 33554432000 4194304 16246674 140735452562912 140735452562224 12752373 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 325777 29334 800 2943 0 322671 0
[pid=6155/tid=6156] ppid=6152 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 1334382592 29344 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 1334382592 29356 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 1334382592 29367 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200629 s]
/proc/loadavg: 2.35 2.34 2.28 3/179 6155
/proc/meminfo: memFree=28845480/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=1311300 CPUtime=0.19 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 42207 0 0 0 13 6 0 0 20 0 4 0 25925764 1342771200 43016 33554432000 4194304 16246674 140735452562912 140735452562224 4220897 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 327825 43016 801 2943 0 324719 0
[pid=6155/tid=6156] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 43016 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 43016 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 43016 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1311300

[startup+0.300463 s]
/proc/loadavg: 2.35 2.34 2.28 3/179 6155
/proc/meminfo: memFree=28845480/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=1311300 CPUtime=0.29 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 42342 0 0 0 23 6 0 0 20 0 4 0 25925764 1342771200 43151 33554432000 4194304 16246674 140735452562912 140735452562224 7376887 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 327825 43151 801 2943 0 324719 0
[pid=6155/tid=6156] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 43151 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 43151 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 43151 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1311300

[startup+0.700426 s]
/proc/loadavg: 2.35 2.34 2.28 3/179 6155
/proc/meminfo: memFree=28845480/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=1311300 CPUtime=0.69 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 130474 0 0 0 51 18 0 0 20 0 4 0 25925764 1342771200 131284 33554432000 4194304 16246674 140735452562912 140735452562224 12449399 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 327825 131297 834 2943 0 324719 0
[pid=6155/tid=6156] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 131309 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 131318 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 1342771200 131327 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1311300

[startup+1.50037 s]
/proc/loadavg: 2.35 2.34 2.28 3/183 6159
/proc/meminfo: memFree=27884420/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=1464900 CPUtime=1.49 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 306668 0 0 0 108 41 0 0 20 0 4 0 25925764 1500057600 307477 33554432000 4194304 16246674 140735452562912 140735452544832 4225154 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 366225 307485 834 2943 0 363119 0
[pid=6155/tid=6156] ppid=6152 vsize=1464900 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 1500057600 307490 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=1464900 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 1500057600 307493 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=1464900 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 1500057600 307500 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1464900

[startup+3.10045 s]
/proc/loadavg: 2.35 2.34 2.28 3/183 6159
/proc/meminfo: memFree=27576296/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=1503812 CPUtime=3.09 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 316575 0 0 0 267 42 0 0 20 0 4 0 25925764 1539903488 317384 33554432000 4194304 16246674 140735452562912 140735452560704 12656213 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 375953 317384 834 2943 0 372847 0
[pid=6155/tid=6156] ppid=6152 vsize=1503812 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 1539903488 317384 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=1503812 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 1539903488 317384 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=1503812 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 1539903488 317384 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1503812

[startup+6.30045 s]
/proc/loadavg: 2.32 2.34 2.27 3/182 6159
/proc/meminfo: memFree=27576468/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=1550916 CPUtime=6.29 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 328250 0 0 0 585 44 0 0 20 0 4 0 25925764 1588137984 329059 33554432000 4194304 16246674 140735452562912 140735452562088 4225154 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 387729 329067 834 2943 0 384623 0
[pid=6155/tid=6156] ppid=6152 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 1588137984 329073 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 1588137984 329078 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 1588137984 329084 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1550916

[startup+12.7004 s]
/proc/loadavg: 2.29 2.33 2.27 3/183 6160
/proc/meminfo: memFree=26459372/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=2973252 CPUtime=12.69 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 683889 0 0 0 1180 89 0 0 20 0 4 0 25925764 3044610048 684698 33554432000 4194304 16246674 140735452562912 140735452560704 4221016 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 743313 684705 835 2943 0 740207 0
[pid=6155/tid=6156] ppid=6152 vsize=2973252 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 3044610048 684712 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=2973252 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 3044610048 684717 33554432000 4194304 16246674 140735452562912 140520471895056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=2973252 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 3044610048 684723 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 2973252

[startup+25.5006 s]
/proc/loadavg: 2.39 2.35 2.28 3/183 6160
/proc/meminfo: memFree=24343900/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=4731460 CPUtime=25.48 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 1123490 0 0 0 2403 145 0 0 20 0 4 0 25925764 4845015040 1124299 33554432000 4194304 16246674 140735452562912 140735452560704 4221138 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 1182865 1124299 835 2943 0 1179759 0
[pid=6155/tid=6156] ppid=6152 vsize=4731460 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 4845015040 1124299 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=4731460 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 4845015040 1124299 33554432000 4194304 16246674 140735452562912 140520471895056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=4731460 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 4845015040 1124299 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 4731460

[startup+51.1006 s]
/proc/loadavg: 2.31 2.33 2.27 4/183 6160
/proc/meminfo: memFree=20285720/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=8781380 CPUtime=51.09 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 2135972 0 0 0 4827 282 0 0 20 0 4 0 25925764 8992133120 2136781 33554432000 4194304 16246674 140735452562912 140735452560768 4206964 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 2195345 2136781 835 2943 0 2192239 0
[pid=6155/tid=6156] ppid=6152 vsize=8781380 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 8992133120 2136781 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=8781380 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 8992133120 2136781 33554432000 4194304 16246674 140735452562912 140520471895056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=8781380 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 8992133120 2136781 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 8781380

[startup+102.301 s]
/proc/loadavg: 2.43 2.36 2.28 3/183 6161
/proc/meminfo: memFree=14965432/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=14090820 CPUtime=102.29 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 3463338 0 0 0 9767 462 0 0 20 0 4 0 25925764 14428999680 3464147 33554432000 4194304 16246674 140735452562912 140735452560768 14003162 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 3522705 3464147 840 2943 0 3519599 0
[pid=6155/tid=6156] ppid=6152 vsize=14090820 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 14428999680 3464147 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=14090820 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 14428999680 3464147 33554432000 4194304 16246674 140735452562912 140520471895056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=14090820 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 14428999680 3464147 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 14090820

[startup+162.3 s]
/proc/loadavg: 2.21 2.31 2.27 3/183 6162
/proc/meminfo: memFree=14032232/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=15223364 CPUtime=162.27 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 3746226 0 0 0 15718 509 0 0 20 0 4 0 25925764 15588724736 3747035 33554432000 4194304 16246674 140735452562912 140735452561576 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 3805841 3747035 840 2943 0 3802735 0
[pid=6155/tid=6156] ppid=6152 vsize=15223364 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 15588724736 3747035 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=15223364 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 15588724736 3747035 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=15223364 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 15588724736 3747039 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 15223364



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+164.3 s]
/proc/loadavg: 2.21 2.31 2.27 3/183 6162
/proc/meminfo: memFree=13295040/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=15891012 CPUtime=164.26 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) R 6152 6155 579 0 -1 4202496 3913297 0 0 0 15892 534 0 0 20 0 4 0 25925764 16272396288 3914106 33554432000 4194304 16246674 140735452562912 140735452562008 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 3972753 3914106 840 2943 0 3969647 0
[pid=6155/tid=6156] ppid=6152 vsize=15891012 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6156/stat : 6156 (toysat) S 6152 6155 579 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25925765 16272396288 3914106 33554432000 4194304 16246674 140735452562912 140520482385136 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=15891012 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) S 6152 6155 579 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25925765 16272396288 3914106 33554432000 4194304 16246674 140735452562912 140520471895280 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=6155/tid=6158] ppid=6152 vsize=15891012 CPUtime=0 cores=1,3,5,7
/proc/6155/task/6158/stat : 6158 (toysat) S 6152 6155 579 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25925765 16272396288 3914106 33554432000 4194304 16246674 140735452562912 140520391175344 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 164.26
Current children cumulated vsize (KiB) 15891012

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6155 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+164.8 s]
/proc/loadavg: 2.21 2.31 2.27 3/183 6162
/proc/meminfo: memFree=13295040/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=0 CPUtime=164.76 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) Z 6152 6155 579 0 -1 4203532 3913691 0 0 0 15893 583 0 0 20 0 2 0 25925764 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 0 0 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=0 CPUtime=0.48 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) R 6152 6155 579 0 -1 4203588 8 0 0 0 0 48 0 0 20 0 2 0 25925765 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 164.76
Current children cumulated vsize (KiB) 0

[startup+165 s]
/proc/loadavg: 2.19 2.30 2.26 3/181 6162
/proc/meminfo: memFree=26149132/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=0 CPUtime=164.97 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) Z 6152 6155 579 0 -1 4203532 3913691 0 0 0 15893 604 0 0 20 0 2 0 25925764 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 0 0 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=0 CPUtime=0.69 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) R 6152 6155 579 0 -1 4203588 8 0 0 0 0 69 0 0 20 0 2 0 25925765 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 164.97
Current children cumulated vsize (KiB) 0

[startup+165.108 s]
/proc/loadavg: 2.19 2.30 2.26 3/181 6162
/proc/meminfo: memFree=26149132/32872528 swapFree=17888/1798212
[pid=6155] ppid=6152 vsize=0 CPUtime=165.07 cores=1,3,5,7
/proc/6155/stat : 6155 (toysat) Z 6152 6155 579 0 -1 4203532 3913691 0 0 0 15893 614 0 0 20 0 2 0 25925764 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/6155/statm: 0 0 0 0 0 0 0
[pid=6155/tid=6157] ppid=6152 vsize=0 CPUtime=0.79 cores=1,3,5,7
/proc/6155/task/6157/stat : 6157 (toysat) R 6152 6155 579 0 -1 4203588 8 0 0 0 0 79 0 0 20 0 2 0 25925765 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 165.07
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 165.149
CPU time (s): 165.117
CPU user time (s): 158.934
CPU system time (s): 6.18306
CPU usage (%): 99.9804
Max. virtual memory (cumulated for all children) (KiB): 15891012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 158.934
system time used= 6.18306
maximum resident set size= 15658000
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3913691
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 66
involuntary context switches= 168

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.03984 second user time and 1.51777 second system time

The end

Launcher Data 

Begin job on node123 at 2016-06-18 10:33:06
IDJOB=4103705
IDBENCH=2437
IDSOLVER=2542
FILE ID=node123/4103705-1466238786
RUNJOBID= node123-1466206081-596
PBS_JOBID= 19918154
Free space on /tmp= 71616 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-scfxm2.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103705-1466238786/watcher-4103705-1466238786 -o /tmp/evaluation-result-4103705-1466238786/solver-4103705-1466238786 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node123-1466206081-596 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103705-1466238786.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8867980cf2a1dbd0adf6037d5e517a28
RANDOM SEED=465011340

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.58
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28846380 kB
Buffers:          117752 kB
Cached:           167564 kB
SwapCached:         1640 kB
Active:           765204 kB
Inactive:         721972 kB
Active(anon):     664092 kB
Inactive(anon):   539980 kB
Active(file):     101112 kB
Inactive(file):   181992 kB
Unevictable:     1798212 kB
Mlocked:           17888 kB
SwapTotal:      67108856 kB
SwapFree:       67099316 kB
Dirty:             18656 kB
Writeback:             0 kB
AnonPages:       2998404 kB
Mapped:            10728 kB
Shmem:                 0 kB
Slab:             603548 kB
SReclaimable:      47620 kB
SUnreclaim:       555928 kB
KernelStack:        1504 kB
PageTables:        10096 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    3140212 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2701312 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71600 MiB
End job on node123 at 2016-06-18 10:35:52