Trace number 4103725

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 199.899 199.938

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-scfxm1.opb
MD5SUMb00fcca5c7683bc6e417430bf4fc75bf
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.868867
Has Objective FunctionYES
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables13710
Total number of constraints327
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints327
Minimum length of a constraint30
Maximum length of a constraint1710
Number of terms in the objective function 690
Biggest coefficient in the objective function 5368709120
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 140660178813
Number of bits of the sum of numbers in the objective function 38
Biggest number in a constraint 53687091200000
Number of bits of the biggest number in a constraint 46
Biggest sum of numbers in a constraint 326830904793855
Number of bits of the biggest sum of numbers49
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T10:35:00+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103725-1466238900.opb"]
0.00/0.01	c use --random-gen="3012461637 3318137628 1463683055 910966436 2632389291 154264460 1478781196 168898944 1562381286 874084781 3416366210 1690843086 3076446851 4160860562 4255243486 3130195741 492199369 3875054312 3614038740 4018419604 933498696 416645694 3565894888 3093429378 3535680442 768863432 1579581276 2950511726 3590952607 1232996986 2911387247 3593875908 2794526432 4155067287 1466408571 1225538060 2473426805 2728627194 228801401 1133588387 3588451557 2921488454 3265425140 2867875094 4289145821 1306918025 520413353 3583766776 1937957789 2875751467 126680052 1481421190 4004695871 2324274661 3648322252 190353684 3237081299 624106562 1535288071 3289133982 1109771980 3665923102 557352156 3841809339 2772824619 1045763280 1596208299 1015394267 3082593797 834659149 2018301316 1116550725 280337098 332103271 2699434036 2639783875 2448765178 648753927 2936167041 3472256864 3182754944 568121197 1567290540 3660759547 600850399 1020624414 3926343184 3781787027 1104252103 831926128 2059846679 1140221231 2454528834 2659015928 1635187553 1521735820 2662628649 1940126605 3688060098 2982286356 906706051 2137516389 2087919073 2846742250 3833826786 2230240059 707441866 3049726541 2043788191 1443018838 1423529949 123004017 1055842660 896310295 2622784530 1630349282 937714944 1349442639 3784586606 2217270407 1428603285 2654895079 3555456729 1381148163 2177966511 2088242011 3065295480 4064747328 342075409 3194621732 3216044391 890755755 549179298 2666881239 2130163080 290331954 1035581978 3473799167 540574025 3950979596 2585191596 580470115 493124802 2840370718 2038572384 2637440384 1848784323 306328592 1566212533 653384934 1459617902 446043495 2413913038 1225940297 2764631410 2475325831 4170689556 2921706937 931495010 2453945234 1816037715 3932336294 430793113 2412772566 584433531 3610536283 3190791718 1852050210 2381426684 1270450639 1235983115 2389911108 379550030 2460236859 1978522857 3608119817 3390790372 400927890 3868197214 1356007425 3631900152 1840718803 660192453 585209279 759620135 411060766 1301722458 1863418078 567548528 3065443725 2024687837 3226340034 3216043214 3767663012 2279032520 1651970578 274371308 1971953291 3372234950 1425706034 1874733798 577770870 3187300438 2704330827 1800300698 3242859024 4081946708 805055370 2346869739 2587170560 3403479640 3863698349 1286145785 119555596 2817912805 4274590937 1767436075 1932548862 2699554742 1597609572 1822643829 1530880593 2428102948 2311478156 289183339 1356408645 3136280585 1889181068 4096347968 2807190697 2202856836 2654378262 3321020649 3118590007 793595809 3015011280 3772433234 1953382106 1389008013 1030607858 1109327519 2094598143 1935306804 1027781211 1779155181 2645317766 3408453284 2923729566 2612751599 333820965 3542116167 208018748 3329948172 1594025468 1615748590 2426162505 255 362436" option to reproduce the execution
0.09/0.17	c #vars 13710
0.09/0.17	c #constraints 327

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103725-1466238900/watcher-4103725-1466238900 -o /tmp/evaluation-result-4103725-1466238900/solver-4103725-1466238900 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11340 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103725-1466238900.opb 

pid=16102
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.09 2.13 2.09 4/179 16105
/proc/meminfo: memFree=18127024/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=777660 CPUtime=0 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 2910 0 0 0 0 0 0 0 20 0 4 0 25940432 796323840 3271 33554432000 4194304 16246674 140735942732128 140735942731552 13880264 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 195183 3280 441 2943 0 192077 0
[pid=16105/tid=16106] ppid=16102 vsize=795068 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 814149632 3339 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=799164 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 818343936 3353 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=803260 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25940432 822538240 3371 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0

[startup+0.100171 s]
/proc/loadavg: 2.09 2.13 2.09 4/179 16105
/proc/meminfo: memFree=18127024/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=1303108 CPUtime=0.09 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 29451 0 0 0 5 4 0 0 20 0 4 0 25940432 1334382592 29750 33554432000 4194304 16246674 140735942732128 140735942731440 8057278 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 325777 29765 800 2943 0 322671 0
[pid=16105/tid=16106] ppid=16102 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 1334382592 29775 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 1334382592 29785 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 1334382592 29796 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200525 s]
/proc/loadavg: 2.09 2.13 2.09 4/179 16105
/proc/meminfo: memFree=18127024/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=1311300 CPUtime=0.19 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 41064 0 0 0 14 5 0 0 20 0 4 0 25940432 1342771200 41873 33554432000 4194304 16246674 140735942732128 140735942731440 13927305 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 327825 41873 823 2943 0 324719 0
[pid=16105/tid=16106] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 41873 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 41873 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 41873 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1311300

[startup+0.300511 s]
/proc/loadavg: 2.09 2.13 2.09 4/179 16105
/proc/meminfo: memFree=18127024/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=1311300 CPUtime=0.29 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 56399 0 0 0 22 7 0 0 20 0 4 0 25940432 1342771200 57208 33554432000 4194304 16246674 140735942732128 140735942731440 12654121 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 327825 57222 823 2943 0 324719 0
[pid=16105/tid=16106] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 57231 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 57240 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 57249 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1311300

[startup+0.700406 s]
/proc/loadavg: 2.09 2.13 2.09 4/179 16105
/proc/meminfo: memFree=18127024/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=1311300 CPUtime=0.68 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 165297 0 0 0 45 23 0 0 20 0 4 0 25940432 1342771200 166106 33554432000 4194304 16246674 140735942732128 140735942714048 12449399 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 327825 166121 823 2943 0 324719 0
[pid=16105/tid=16106] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 166129 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 166138 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 1342771200 166147 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 1311300

[startup+1.50039 s]
/proc/loadavg: 2.09 2.13 2.09 3/183 16109
/proc/meminfo: memFree=17044584/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=1496644 CPUtime=1.49 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 314563 0 0 0 107 42 0 0 20 0 4 0 25940432 1532563456 315372 33554432000 4194304 16246674 140735942732128 140735942731440 12429806 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 374161 315372 824 2943 0 371055 0
[pid=16105/tid=16106] ppid=16102 vsize=1496644 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 1532563456 315372 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=1496644 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 1532563456 315372 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=1496644 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 1532563456 315372 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1496644

[startup+3.10041 s]
/proc/loadavg: 2.09 2.13 2.09 3/183 16109
/proc/meminfo: memFree=16865048/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=1496644 CPUtime=3.09 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 314772 0 0 0 267 42 0 0 20 0 4 0 25940432 1532563456 315581 33554432000 4194304 16246674 140735942732128 140735942731440 4206505 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 374161 315581 824 2943 0 371055 0
[pid=16105/tid=16106] ppid=16102 vsize=1496644 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 1532563456 315581 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=1496644 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 1532563456 315581 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=1496644 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 1532563456 315581 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1496644

[startup+6.30041 s]
/proc/loadavg: 2.08 2.13 2.09 3/183 16109
/proc/meminfo: memFree=16864804/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=1899076 CPUtime=6.29 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 415277 0 0 0 573 56 0 0 20 0 4 0 25940432 1944653824 416086 33554432000 4194304 16246674 140735942732128 140735942731440 12654369 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 474769 416086 824 2943 0 471663 0
[pid=16105/tid=16106] ppid=16102 vsize=1899076 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 1944653824 416086 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=1899076 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 1944653824 416086 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=1899076 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 1944653824 416086 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1899076

[startup+12.7004 s]
/proc/loadavg: 2.08 2.13 2.09 3/183 16109
/proc/meminfo: memFree=15578372/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=2780740 CPUtime=12.69 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 635796 0 0 0 1182 87 0 0 20 0 4 0 25940432 2847477760 636605 33554432000 4194304 16246674 140735942732128 140735942731304 15015658 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 695185 636605 824 2943 0 692079 0
[pid=16105/tid=16106] ppid=16102 vsize=2780740 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 2847477760 636605 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=2780740 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 2847477760 636605 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=2780740 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 2847477760 636605 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 2780740

[startup+25.5005 s]
/proc/loadavg: 2.06 2.12 2.09 3/183 16109
/proc/meminfo: memFree=13272188/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=5082692 CPUtime=25.49 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 1211286 0 0 0 2388 161 0 0 20 0 4 0 25940432 5204676608 1212095 33554432000 4194304 16246674 140735942732128 140735942731224 4225056 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 1270673 1212095 825 2943 0 1267567 0
[pid=16105/tid=16106] ppid=16102 vsize=5082692 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 5204676608 1212095 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=5082692 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 5204676608 1212095 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=5082692 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 5204676608 1212095 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 5082692

[startup+51.1005 s]
/proc/loadavg: 2.10 2.12 2.09 3/183 16109
/proc/meminfo: memFree=9020680/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=9325124 CPUtime=51.08 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 2271896 0 0 0 4809 299 0 0 20 0 4 0 25940432 9548926976 2272705 33554432000 4194304 16246674 140735942732128 140735942731224 15015658 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 2331281 2272705 825 2943 0 2328175 0
[pid=16105/tid=16106] ppid=16102 vsize=9325124 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 9548926976 2272705 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=9325124 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 9548926976 2272705 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=9325124 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 9548926976 2272705 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9325124

[startup+102.3 s]
/proc/loadavg: 2.09 2.12 2.09 3/183 16159
/proc/meminfo: memFree=10406388/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=13911620 CPUtime=102.28 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 3418526 0 0 0 9763 465 0 0 20 0 4 0 25940432 14245498880 3419591 33554432000 4194304 16246674 140735942732128 140735942730048 14013642 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 3477905 3419591 830 2943 0 3474799 0
[pid=16105/tid=16106] ppid=16102 vsize=13911620 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 14245498880 3419591 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=13911620 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 14245498880 3419591 33554432000 4194304 16246674 140735942732128 140419660753936 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=13911620 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 14245498880 3419591 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 13911620

[startup+162.3 s]
/proc/loadavg: 2.07 2.11 2.09 3/183 16160
/proc/meminfo: memFree=2971464/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=15752772 CPUtime=162.26 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 3819965 0 0 0 15695 531 0 0 20 0 4 0 25940432 16130838528 3879795 33554432000 4194304 16246674 140735942732128 140735942730112 4220520 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 3938193 3879795 830 2943 0 3935087 0
[pid=16105/tid=16106] ppid=16102 vsize=15752772 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 16130838528 3879795 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=15752772 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 16130838528 3879795 33554432000 4194304 16246674 140735942732128 140419660753936 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=15752772 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 16130838528 3879795 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 15752772



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+199.1 s]
/proc/loadavg: 2.08 2.11 2.09 3/183 16161
/proc/meminfo: memFree=2834376/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=15893060 CPUtime=199.06 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) R 16102 16105 11324 0 -1 4202496 3855093 0 0 0 19369 537 0 0 20 0 4 0 25940432 16274493440 3914923 33554432000 4194304 16246674 140735942732128 140735942731224 4221016 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 3973265 3914927 830 2943 0 3970159 0
[pid=16105/tid=16106] ppid=16102 vsize=15894084 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16106/stat : 16106 (toysat) S 16102 16105 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25940432 16275542016 3914984 33554432000 4194304 16246674 140735942732128 140419743591664 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=15894084 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) S 16102 16105 11324 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 25940432 16275542016 3914990 33554432000 4194304 16246674 140735942732128 140419660754160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=16105/tid=16108] ppid=16102 vsize=15894084 CPUtime=0 cores=0,2,4,6
/proc/16105/task/16108/stat : 16108 (toysat) S 16102 16105 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25940432 16275542016 3914994 33554432000 4194304 16246674 140735942732128 140419650280624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 199.06
Current children cumulated vsize (KiB) 15893060

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 16105 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+199.212 s]
/proc/loadavg: 2.08 2.11 2.09 3/183 16161
/proc/meminfo: memFree=2834376/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=0 CPUtime=199.17 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) Z 16102 16105 11324 0 -1 4203532 3855600 0 0 0 19370 547 0 0 20 0 2 0 25940432 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 0 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=0 CPUtime=0.09 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) R 16102 16105 11324 0 -1 4203588 7 0 0 0 0 9 0 0 20 0 2 0 25940432 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 199.17
Current children cumulated vsize (KiB) 0

[startup+199.6 s]
/proc/loadavg: 2.08 2.11 2.09 3/183 16161
/proc/meminfo: memFree=2834376/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=0 CPUtime=199.56 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) Z 16102 16105 11324 0 -1 4203532 3855600 0 0 0 19370 586 0 0 20 0 2 0 25940432 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 0 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=0 CPUtime=0.47 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) R 16102 16105 11324 0 -1 4203588 7 0 0 0 0 47 0 0 20 0 2 0 25940432 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 199.56
Current children cumulated vsize (KiB) 0

[startup+199.8 s]
/proc/loadavg: 2.08 2.11 2.09 3/183 16161
/proc/meminfo: memFree=2834376/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=0 CPUtime=199.76 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) Z 16102 16105 11324 0 -1 4203532 3855600 0 0 0 19370 606 0 0 20 0 2 0 25940432 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 0 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=0 CPUtime=0.67 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) R 16102 16105 11324 0 -1 4203588 7 0 0 0 0 67 0 0 20 0 2 0 25940432 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 199.76
Current children cumulated vsize (KiB) 0

[startup+199.9 s]
/proc/loadavg: 2.08 2.11 2.09 3/183 16161
/proc/meminfo: memFree=2834376/32872528 swapFree=249320/249320
[pid=16105] ppid=16102 vsize=0 CPUtime=199.86 cores=0,2,4,6
/proc/16105/stat : 16105 (toysat) Z 16102 16105 11324 0 -1 4203532 3855600 0 0 0 19370 616 0 0 20 0 2 0 25940432 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/16105/statm: 0 0 0 0 0 0 0
[pid=16105/tid=16107] ppid=16102 vsize=0 CPUtime=0.77 cores=0,2,4,6
/proc/16105/task/16107/stat : 16107 (toysat) R 16102 16105 11324 0 -1 4203588 7 0 0 0 0 77 0 0 20 0 2 0 25940432 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 199.86
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 199.938
CPU time (s): 199.899
CPU user time (s): 193.705
CPU system time (s): 6.19406
CPU usage (%): 99.9802
Max. virtual memory (cumulated for all children) (KiB): 15893060

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 193.705
system time used= 6.19406
maximum resident set size= 15661720
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3855600
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 72
involuntary context switches= 203

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.52192 second user time and 0.759884 second system time

The end

Launcher Data 

Begin job on node103 at 2016-06-18 10:35:00
IDJOB=4103725
IDBENCH=2444
IDSOLVER=2542
FILE ID=node103/4103725-1466238900
RUNJOBID= node103-1466206104-11340
PBS_JOBID= 19918169
Free space on /tmp= 71704 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-scfxm1.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103725-1466238900/watcher-4103725-1466238900 -o /tmp/evaluation-result-4103725-1466238900/solver-4103725-1466238900 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11340 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103725-1466238900.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b00fcca5c7683bc6e417430bf4fc75bf
RANDOM SEED=294294737

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        18127296 kB
Buffers:          129576 kB
Cached:           154620 kB
SwapCached:         2188 kB
Active:         13552576 kB
Inactive:         182256 kB
Active(anon):   13449204 kB
Inactive(anon):     3672 kB
Active(file):     103372 kB
Inactive(file):   178584 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             17692 kB
Writeback:             0 kB
AnonPages:      13707096 kB
Mapped:            10704 kB
Shmem:                 0 kB
Slab:             603556 kB
SReclaimable:      47128 kB
SUnreclaim:       556428 kB
KernelStack:        1520 kB
PageTables:        30884 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:   13838840 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:     57344 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71696 MiB
End job on node103 at 2016-06-18 10:38:20